-- Logs begin at Tue 2022-07-26 13:51:31 UTC, end at Tue 2022-07-26 15:27:12 UTC. -- Jul 26 14:54:11.570946 dv-cinder-850668-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 14:54:11.580256 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:54:11 2022] *** Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: nodename: dv-cinder-850668-2-iscsi Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: machine: x86_64 Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: clock source: unix Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: pcre jit disabled Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: detected number of CPU cores: 4 Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: current working directory: / Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: your processes number limit is 47680 Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: your memory page size is 4096 bytes Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: detected max file descriptor number: 2048 Jul 26 14:54:11.583201 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: lock engine: pthread robust mutexes Jul 26 14:54:11.584227 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: thunder lock: enabled Jul 26 14:54:11.584227 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 14:54:11.584227 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:54:11.623797 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: Python main interpreter initialized at 0x56477bcdd9c0 Jul 26 14:54:11.623797 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: python threads support enabled Jul 26 14:54:11.623797 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: your server socket listen backlog is limited to 100 connections Jul 26 14:54:11.623797 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:54:11.624295 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:54:11.624295 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: *** Operational MODE: preforking *** Jul 26 14:54:11.624516 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:54:11.624516 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: spawned uWSGI master process (pid: 115647) Jul 26 14:54:11.624734 dv-cinder-850668-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 14:54:11.625502 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: spawned uWSGI worker 1 (pid: 115648, cores: 1) Jul 26 14:54:11.625663 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: spawned uWSGI worker 2 (pid: 115649, cores: 1) Jul 26 14:54:11.625815 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:54:12.361813 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:54:12.414513 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:54:13.513489 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:54:13.513489 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: from cryptography.utils import int_from_bytes Jul 26 14:54:13.514080 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:54:13.514080 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: from cryptography.utils import int_from_bytes Jul 26 14:54:13.564543 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:54:13.564543 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: from cryptography.utils import int_from_bytes Jul 26 14:54:13.565205 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:54:13.565205 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: from cryptography.utils import int_from_bytes Jul 26 14:54:16.174384 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:54:16.175321 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:54:16.175321 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:54:16.175619 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:54:16.175851 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:54:16.176249 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.176574 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.176896 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.177215 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.177547 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.177861 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.178181 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.178514 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.178833 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.179088 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.179406 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.179759 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850668-2-iscsi {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.180083 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.180391 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.180703 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.181018 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.181321 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.181666 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.181945 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.182443 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.182897 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.183207 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.183571 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.183951 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.184291 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.184607 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.185005 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.185319 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.185694 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.185992 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.186405 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850668-2-iscsi {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.186748 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.187044 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.187362 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.188076 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.188563 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.188891 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.189222 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.189572 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.189887 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.190219 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.192105 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.192105 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.192105 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.192664 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.192856 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:54:16.193639 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.193834 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:54:16.194028 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.194028 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.194404 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:54:16.194600 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.194945 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:54:16.195147 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.195348 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:54:16.195542 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.195756 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.195956 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.196148 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.196348 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.196544 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.196740 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.196937 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.197149 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.197149 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.197519 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.197721 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.197921 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.198121 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.198321 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.198516 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.198716 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.198915 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.199134 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.199361 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.199594 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.199798 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.199996 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.200201 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.200400 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850668-2-iscsi {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.200608 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.200806 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.201001 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.201203 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.201403 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.201601 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.201795 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.201967 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.202167 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.202363 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.202565 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.202918 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.203167 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.203358 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.203565 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.203775 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.204030 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.204217 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.204415 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.204619 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.204823 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.204823 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.205363 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.205554 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.205740 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.205740 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.206659 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.207156 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.208041 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.208217 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.208392 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.208562 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.208744 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.208928 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.209111 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.209286 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.209470 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.209470 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.209820 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850668-2-iscsi {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210012 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210204 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210204 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210590 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210780 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210975 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.210975 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.211341 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.211568 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.211755 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.211946 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.212148 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.212330 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.212528 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.212732 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.212926 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.212926 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.213292 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.213482 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.213679 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.213889 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.214077 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.214268 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.214452 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.214651 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.214853 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.215053 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.215424 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.215663 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.215849 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.216049 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.216250 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.216443 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.216627 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.216818 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.217008 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.217192 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.217391 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.217591 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.217788 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.217973 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.218162 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.218344 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.218541 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.218734 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.218921 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.219109 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.219109 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.219501 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.219685 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.219876 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.220070 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.220293 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.220523 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.220726 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.220918 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.221118 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.221329 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.221550 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.221735 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.222786 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.223027 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.223218 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.223218 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.223614 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.223819 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.224031 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.224234 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.224426 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.224620 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.224817 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.225133 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.225358 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.225686 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.225883 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.226070 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.226257 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.226455 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.226640 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.226830 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.227011 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.227196 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.227392 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.227649 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.227848 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.228051 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.228248 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.228445 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.228635 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.228835 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.229031 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.229276 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.229462 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.229642 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.229836 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.230027 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.230209 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.230395 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.230575 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.230773 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.230974 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.231161 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.231347 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.231570 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.231755 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.231924 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.232116 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.232302 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.232501 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.232688 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.232884 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.233070 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.233269 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.233457 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.233645 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.233828 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.234015 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.234208 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.234384 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.234567 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.234756 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.234947 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.235133 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.235330 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.235578 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.235950 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.236139 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.236346 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.236540 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.236749 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.236951 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.237190 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.237384 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.239831 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.240000 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.240133 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.240261 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.240386 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.240517 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.240640 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.240771 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.240905 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.241036 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.241165 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.241288 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.241408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.241537 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.241659 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.241780 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.241908 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.242037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.242159 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.242159 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.242406 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.242529 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.242673 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.247698 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.248510 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.248771 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.248917 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.248917 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.249196 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.249196 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.249364 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.249444 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.249528 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.249616 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.249701 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.249780 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.249865 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.249988 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.250117 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.250239 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.250381 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.250515 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.250602 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.250680 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.250779 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.250917 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.251069 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.251228 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.251370 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.251544 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.251671 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.251762 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.251848 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.251936 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.252023 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.252112 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.252212 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.252299 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.252379 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.252464 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.252544 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.252611 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.252675 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.252749 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.253349 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.253427 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.253506 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.253641 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.253768 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.253908 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.254039 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.254179 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.254313 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.254449 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.254533 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.254615 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.254683 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.254833 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.254911 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:54:16.254985 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255064 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255138 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255212 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255280 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255352 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255425 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255529 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255606 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255681 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255748 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255825 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255891 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.255962 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256036 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256111 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256197 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256294 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256367 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256432 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256521 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256589 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256654 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256718 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256782 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256846 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256919 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.256985 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257049 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257113 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257184 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257250 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257327 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257394 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257465 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257538 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257604 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257669 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257746 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257820 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257894 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.257966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258031 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258103 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258169 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258233 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258303 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258369 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258451 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258524 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258597 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258663 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258727 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258792 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258863 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.258936 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259010 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259083 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259155 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259220 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259290 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259364 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259430 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259430 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259775 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259842 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259920 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.259993 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260069 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260142 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260207 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260207 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260396 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260530 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260681 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260810 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260905 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.260985 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261120 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261217 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261304 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261407 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261524 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261524 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261755 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261838 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261914 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.261981 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.262056 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.262594 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.262767 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.262898 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263006 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263112 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263227 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263342 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263448 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263620 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263733 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263838 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.263838 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264047 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264164 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264277 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264394 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264500 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264864 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264986 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.264986 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265191 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265294 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265294 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265529 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265644 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265752 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265866 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.265971 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266111 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266289 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266406 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266513 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266639 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266758 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266871 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.266986 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267098 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267204 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267308 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267429 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267561 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267703 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267834 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.267957 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.268080 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.268211 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.268335 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.268519 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269139 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269265 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269406 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269543 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269698 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269928 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.269928 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270140 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270220 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270306 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270393 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270480 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270567 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270647 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270781 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270871 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.270949 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271076 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271160 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271238 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271315 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271539 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271623 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271745 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271870 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.271960 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272049 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272135 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272214 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272300 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272379 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272456 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272541 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272541 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272683 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272767 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272845 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.272923 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273013 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273092 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273170 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273246 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273246 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273466 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273636 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273636 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273782 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273867 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.273867 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274015 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274095 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274180 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274258 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274258 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274405 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274490 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274490 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274652 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274740 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274819 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274903 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.274903 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275059 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275138 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275215 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275291 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275375 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275565 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275652 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275783 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275866 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.275944 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276087 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276171 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276249 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276349 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276498 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276595 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276693 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276774 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276774 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.276924 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277061 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277145 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277236 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277331 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277434 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277514 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277591 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277680 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277768 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277768 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277910 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.277995 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278074 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278150 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278150 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278307 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278392 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278543 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278646 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.278876 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.279101 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.279188 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.279565 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.279704 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.279831 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.280146 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.280238 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.280453 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.280764 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.280849 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.281074 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.281303 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.281399 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.281688 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.281848 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.281987 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.282297 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.282451 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.282603 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.282922 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.283008 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.283229 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.283558 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.283655 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.283924 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.284822 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.284998 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.284998 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.285300 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.285522 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.285669 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.285821 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.285821 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.285993 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.286083 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.286307 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.286540 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.286780 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.286928 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.287269 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.287563 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.287656 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.287803 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.288087 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.288184 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.288427 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.288643 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.288734 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.289045 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.289191 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.289364 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.289700 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.289793 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.290009 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.290264 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.290363 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.290615 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.290816 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.290992 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.291384 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.291550 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.291777 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.291991 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.292134 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.292403 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.292533 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.292706 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.293009 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.293107 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.293341 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.293594 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.293692 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.294348 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.294490 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.294585 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.294682 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.295016 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.295761 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.295761 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.295928 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.296024 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.296356 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.296458 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.296683 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.296945 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.297055 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.298651 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.298889 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.298995 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.298995 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.299254 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.299407 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.299591 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.299732 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.299882 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300033 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300033 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300301 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300434 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300557 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300647 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.300647 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301018 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301101 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301188 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301275 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301365 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301435 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301528 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301605 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301757 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.301993 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.302077 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.302156 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.302469 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.302629 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.302961 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.303047 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.303283 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.303427 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.303654 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.303782 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.303982 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.304104 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.304299 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.304400 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.304626 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.304713 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.304957 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.305070 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.305322 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.305451 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.305626 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.305828 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.305960 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.306140 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.306275 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.306444 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.306625 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.306825 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.306942 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.307230 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.307325 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.307578 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.307683 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.307929 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308024 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308268 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308355 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308577 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308673 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308881 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.308968 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.309185 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.309271 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.309531 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.309621 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.309837 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.309923 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.310154 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.310241 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.310457 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.310542 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.310763 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.310846 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.311062 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.311137 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.311386 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.311537 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.311713 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.311801 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.312030 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.312117 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.312358 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.312601 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.312698 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.312920 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313007 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313264 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313364 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313587 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313680 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313889 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.313977 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.314210 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.314298 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.314521 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.314617 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.314831 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.314944 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.315136 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.315988 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316112 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316218 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316334 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316426 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316640 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316760 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.316954 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317042 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317257 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317349 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317574 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317670 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317880 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.317991 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.318183 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.318338 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.318480 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.318621 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.318774 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.318874 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.319084 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.319240 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.319387 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.319523 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.319723 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.319812 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320028 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320189 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320340 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320439 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320639 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320741 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.320932 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.321017 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.321231 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.321308 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.321539 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.321657 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.321944 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.322107 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.322274 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.322547 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.322643 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.322890 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.322988 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.323195 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.323327 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.323525 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.323665 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.323820 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.323973 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.324109 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.324251 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.324416 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.324536 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.324719 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.324830 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325023 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325132 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325330 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325474 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325659 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325782 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.325960 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.326087 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.326286 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.326441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.326575 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.326723 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.326879 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.327035 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.327273 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.327376 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.327610 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.327702 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.327965 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.328053 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.328352 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.328462 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.328720 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.328808 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329026 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329120 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329342 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329510 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329666 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329761 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.329970 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.330064 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.330272 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.330374 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.330577 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.330674 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.330902 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.331026 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.331801 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.331905 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.332102 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.332235 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.332403 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.332675 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.332767 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.332990 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.333080 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.333300 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.333395 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.333630 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.333725 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.333932 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334020 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334231 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334326 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334577 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334673 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334880 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.334968 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.335213 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.335336 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.335553 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.335716 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.335867 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.335958 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.336173 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.336309 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.336487 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.336642 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.336796 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.336974 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.337113 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.337293 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.337434 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.337620 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.337746 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338030 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338125 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338356 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338453 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338673 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338800 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.338978 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.339066 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.339291 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.339404 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.339629 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.339727 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.339937 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340032 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340266 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340363 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340578 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340665 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340883 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.340971 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.341193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.341272 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.341500 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.341588 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.341815 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.341957 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.342118 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.342206 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.342450 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.342562 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.342751 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.342898 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.343038 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.343163 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.343382 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.343551 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.343724 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.343867 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344038 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344179 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344351 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344494 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344661 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344814 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.344967 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.345119 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.345275 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.345553 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.345641 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.345873 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.345976 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.346175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.346262 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.347387 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348216 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348329 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348412 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348490 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348577 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348656 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348737 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348826 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.348914 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349005 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349084 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349084 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349233 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349312 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349389 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349473 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349777 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.349910 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.350098 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.350342 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.350529 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.350800 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.350940 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.351132 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.351270 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.351602 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.351795 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.351930 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.352333 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.352469 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.352866 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.352947 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.353193 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.353325 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.353506 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.353697 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.353814 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.354037 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.354196 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.354359 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.354485 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.354689 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.354802 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.355008 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.355127 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.355343 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.355537 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.355705 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.355784 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356032 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356134 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356347 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356483 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356802 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356894 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.356970 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.357304 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.357616 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.357831 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.357977 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.358056 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.358474 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.358567 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.358734 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.358819 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.359194 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.359347 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.359437 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.359699 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.359799 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360013 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360123 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360315 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360404 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360629 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360747 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.360940 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361053 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361553 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361697 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361697 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361850 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361916 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.361980 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.362863 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363017 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363140 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363268 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363481 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363598 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363797 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.363928 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.364105 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.364256 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.364426 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.364548 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.364745 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.364824 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.365062 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.365139 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.365384 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.365476 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.365733 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.365822 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.366070 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.366171 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.366359 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.366685 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.366845 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.366996 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.367134 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.367309 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.367492 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.367650 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.367881 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.367970 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.368196 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.368285 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.368513 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.368602 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.368820 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.368908 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.369131 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.369277 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.369495 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.369573 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.369813 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.369937 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.370126 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.370258 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.370434 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.370523 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.370743 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.370831 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.371054 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.371196 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.371352 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.371443 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.371702 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.371843 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.372024 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.372341 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.372484 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.372885 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373011 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373148 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373246 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373398 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373567 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373662 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373869 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.373964 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.374174 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.374275 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.374479 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.374567 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.374805 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.374937 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.375110 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.375246 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.375432 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.375575 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.375766 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.375842 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.376071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.376160 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.376377 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.376593 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.376688 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.376934 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.377067 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.377262 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.377351 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.377592 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.377679 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.377968 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.378076 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.378302 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.378387 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.378638 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.378745 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.378958 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.379063 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.379270 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.379414 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.379634 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.379713 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.379959 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380089 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380276 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380405 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380587 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380677 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380894 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.380982 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.381204 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.381305 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.381506 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.381602 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.381816 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.381922 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.382118 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.382220 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.382419 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.382516 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.382722 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.382810 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.383042 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.383307 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.383408 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.383668 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.383760 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.383975 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.384062 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.384283 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.384413 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.384605 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.384695 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.384927 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385021 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385243 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385320 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385590 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385679 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385872 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.385949 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.386187 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.386284 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.386503 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.386592 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.386843 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.386965 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.387160 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.387282 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.387520 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.387613 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.387869 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.387988 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.388230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.388355 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.388548 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.388761 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.388914 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.389001 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.389169 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.389290 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.389536 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.389944 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.390108 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.390330 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.390428 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.390721 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.390808 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391040 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391128 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391356 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391473 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391695 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391901 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.391990 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.392309 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.392621 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.392709 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.392931 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.393018 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.393242 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.393331 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.393619 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.393758 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.393932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.394059 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.394259 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.394412 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.394693 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.394782 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.395061 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.395168 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.395393 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.395668 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.395757 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.395993 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.396125 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.396566 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.396720 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.396883 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.397162 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.397261 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.397565 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.397753 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.397844 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.398150 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.398468 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.398573 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.398784 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.398885 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.399091 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.399364 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.399491 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.399727 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.399881 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.400039 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.400345 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.400450 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.400670 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.400982 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.401060 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.401290 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.401616 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.401795 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403187 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403336 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403512 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403661 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403802 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403802 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.403949 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404017 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404017 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404150 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404279 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404546 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404637 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.404899 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.405123 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.405221 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.405500 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.405689 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.405806 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.406116 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.406304 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.406420 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.406726 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.406813 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.407038 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.407353 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.407451 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.407698 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.408014 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.408103 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.408322 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.408619 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.408737 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.408921 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.409765 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.409970 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.410148 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.410367 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.410664 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.410952 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.411240 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.411553 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.411850 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.412129 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.412429 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.412602 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.412744 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.413019 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.413110 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.413338 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.413719 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.413962 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.414061 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.414272 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.414579 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.414681 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.414959 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.415228 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.415641 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.415886 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.416264 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.416487 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.416661 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.416982 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.417133 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.417312 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.417635 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.417752 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.417959 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.418102 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.418275 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.418429 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.418595 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.418823 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.418949 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.419158 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.419266 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.419539 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.419884 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.420006 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.420218 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.420330 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.420544 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.420626 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.420884 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.421019 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.421193 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.421266 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.421504 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.421606 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.421812 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.422117 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.422205 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.422465 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.422563 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.422754 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.422854 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.423065 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.423220 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.423376 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.423594 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.423719 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.424023 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.424164 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.424333 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.424471 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.424746 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.425341 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.425624 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.425749 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.426076 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.426206 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.426447 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.426571 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.426778 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.426874 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.427087 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.427296 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.427404 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.427728 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.427868 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.428182 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.428424 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.428568 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.429026 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.429350 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.429486 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.429703 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.429826 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430012 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430158 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430317 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430484 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430623 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430812 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.430939 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.431132 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.431231 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.431479 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.431570 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.431790 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.431878 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.432106 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.432194 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.432428 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.432507 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.432764 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.432852 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.433089 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.433220 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.433397 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.433481 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.433741 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.433830 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.434045 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.434133 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.434354 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.434441 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.434705 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.434794 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.435034 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.435121 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.435343 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.435616 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.435722 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.435985 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.436089 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.436323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.436595 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.436730 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.436819 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.436962 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.437124 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.437256 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.437470 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.437637 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.437813 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.437954 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.438254 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.438474 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.438563 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.438825 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.438930 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.439096 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.439359 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.439440 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.439686 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.439789 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.440023 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.440166 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.440562 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.440651 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.440774 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.440862 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.441082 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.441240 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.441405 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.441670 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.441836 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.441976 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.442129 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.442438 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.442577 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.442731 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.442984 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.443126 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.443266 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.443266 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.443593 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.443759 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.443903 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444045 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444156 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444226 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444291 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444399 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444483 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444667 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444837 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.444976 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445114 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445265 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445414 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445550 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445693 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445825 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.445958 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.446141 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.446234 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.446441 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.446519 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.446781 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.446878 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.447116 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.447196 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.447431 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.447590 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.447767 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.447854 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.448078 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.448166 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.448415 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.448518 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.448694 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.448797 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.449014 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.449141 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.449400 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.449553 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.449717 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.449807 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450023 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450111 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450359 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450445 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450681 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450800 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.450988 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.451084 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.451300 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.451397 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.451643 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.451742 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.451957 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.452053 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.452269 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.452357 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.452602 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.452690 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.452922 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453009 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453319 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453555 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453664 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453863 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.453950 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.454187 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.454343 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.454500 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.454604 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.454804 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.454916 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.455114 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.455254 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.455412 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.455531 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.455770 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.455914 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.456126 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.456273 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.456414 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.456546 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.456721 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.456880 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.457122 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.457223 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.457441 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.457543 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.457756 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.457885 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458069 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458158 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458370 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458481 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458679 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458808 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.458980 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459067 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459289 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459394 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459616 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459787 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459893 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.459975 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.460199 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.460288 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.460504 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.460614 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.460806 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.460945 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.461105 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.461247 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.461427 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.461564 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.461736 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.461861 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.462037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.462166 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.462340 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.462426 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:54:16.462762 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.463154 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.463377 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.463720 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.464039 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.464352 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.464770 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.465188 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.465575 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.466135 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.466602 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.466917 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.467279 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.467619 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.468016 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.468336 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.468666 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.469039 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.469435 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.469735 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.470064 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.470366 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.470772 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.471300 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.472281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.472766 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.473113 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.473558 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.473975 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.474385 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.474901 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.475275 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.475716 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.476152 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.476561 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.476980 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.477399 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.477841 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.478248 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.478583 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.478970 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.479569 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.480303 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.480439 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.480711 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.481131 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.481463 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.481779 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.482092 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.482412 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:54:16.482652 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:54:16.620641 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO dbcounter [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Registered counter for database nova_api Jul 26 14:54:16.639382 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO dbcounter [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Registered counter for database nova_api Jul 26 14:54:16.642556 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_db.sqlalchemy.engines [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.649946 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writer thread running {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.660700 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_db.sqlalchemy.engines [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.667295 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writer thread running {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.708510 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.context [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),edd000c1-ec71-4e3a-8f05-9866da848ed5(cell1) {{(pid=115648) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:54:16.712522 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.714155 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.714974 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.717047 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.719179 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO dbcounter [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Registered counter for database nova_cell0 Jul 26 14:54:16.725616 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.context [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),edd000c1-ec71-4e3a-8f05-9866da848ed5(cell1) {{(pid=115649) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:54:16.726029 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO dbcounter [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Registered counter for database nova_cell1 Jul 26 14:54:16.729888 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_concurrency.lockutils [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.731565 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_concurrency.lockutils [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.732399 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_concurrency.lockutils [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.734498 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_concurrency.lockutils [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.735389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_db.sqlalchemy.engines [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.736595 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO dbcounter [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Registered counter for database nova_cell0 Jul 26 14:54:16.736733 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_db.sqlalchemy.engines [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.742406 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO dbcounter [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Registered counter for database nova_cell1 Jul 26 14:54:16.743741 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writer thread running {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.745259 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writer thread running {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.749823 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_db.sqlalchemy.engines [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.751907 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_db.sqlalchemy.engines [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.759278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writer thread running {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.760840 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writer thread running {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.902072 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO dbcounter [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Registered counter for database nova_cell0 Jul 26 14:54:16.911818 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_db.sqlalchemy.engines [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.915301 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO dbcounter [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Registered counter for database nova_cell0 Jul 26 14:54:16.917927 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writer thread running {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:16.925919 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG oslo_db.sqlalchemy.engines [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:16.930713 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writer thread running {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:17.382971 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: WARNING keystonemiddleware.auth_token [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:54:17.391063 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: WARNING keystonemiddleware.auth_token [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:54:17.455951 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: WARNING keystonemiddleware.auth_token [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:54:17.465011 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: WARNING keystonemiddleware.auth_token [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:54:17.794136 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: WARNING keystonemiddleware.auth_token [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:54:17.802007 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: WARNING keystonemiddleware.auth_token [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:54:17.808551 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56477bcdd9c0 pid: 115648 (default app) Jul 26 14:54:17.810911 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:17.812175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] 10.222.0.94 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001978 Jul 26 14:54:17.812606 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 788 bytes} [Tue Jul 26 14:54:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:17.868260 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: WARNING keystonemiddleware.auth_token [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:54:17.876420 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: WARNING keystonemiddleware.auth_token [None req-784107f7-c3f3-4eb8-93c4-55fd06161893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:54:17.886596 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56477bcdd9c0 pid: 115649 (default app) Jul 26 14:55:55.242656 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:55.245229 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003158 Jul 26 14:55:55.256722 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 2/2] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:55.270385 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_api:SELECT=3 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.271991 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_cell0:SELECT=3 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.273941 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_cell1:SELECT=3 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.275068 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:56.573851 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-4551985a-9c0e-4759-ae8b-a94da92cdb09 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:56.611387 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-4551985a-9c0e-4759-ae8b-a94da92cdb09 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.352720 Jul 26 14:55:56.612293 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 1/3] 10.222.0.94 () {60 vars in 1291 bytes} [Tue Jul 26 14:55:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:59.501886 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:59.503723 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-e83ddab8-2e25-4c18-9715-8feb701b0f44 None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002458 Jul 26 14:55:59.504499 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 3/4] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:56:00.235131 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-5de1724f-c414-4675-be9b-76cb5b6a5b9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:00.274327 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:56:00.274327 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: warnings.warn(msg) Jul 26 14:56:00.384752 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-5de1724f-c414-4675-be9b-76cb5b6a5b9d admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.868079 Jul 26 14:56:00.385570 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 2/5] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:55:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:56:00.404158 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_api:SELECT=3 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.406451 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_cell1:SELECT=3 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.407649 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_cell0:SELECT=3 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.409666 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.632375 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-61ebb0ca-831f-457e-8719-bf52c16b7999 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:00.637361 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:56:00.637361 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: warnings.warn(msg) Jul 26 14:56:00.810582 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-61ebb0ca-831f-457e-8719-bf52c16b7999 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.412633 Jul 26 14:56:00.812186 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 4/6] 10.222.0.94 () {64 vars in 1335 bytes} [Tue Jul 26 14:56:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:03.424430 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-5de1724f-c414-4675-be9b-76cb5b6a5b9d admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:03.425889 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-5de1724f-c414-4675-be9b-76cb5b6a5b9d admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001886 Jul 26 14:56:03.426622 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 3/7] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:04.438324 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-db1bd55c-2bab-43e6-b480-853836bf4ec0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:04.471683 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:56:04.471683 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: warnings.warn(msg) Jul 26 14:56:04.599405 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-db1bd55c-2bab-43e6-b480-853836bf4ec0 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.161612 Jul 26 14:56:04.608876 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 5/8] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:04.617785 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-5ead839b-3874-4fc3-b9b8-9b8dc47e419b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:04.621752 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:56:04.621752 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: warnings.warn(msg) Jul 26 14:56:04.770868 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-5ead839b-3874-4fc3-b9b8-9b8dc47e419b admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159494 Jul 26 14:56:04.779935 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 4/9] 10.222.0.94 () {64 vars in 1335 bytes} [Tue Jul 26 14:56:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:07.602005 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-db1bd55c-2bab-43e6-b480-853836bf4ec0 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:07.603135 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-db1bd55c-2bab-43e6-b480-853836bf4ec0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Jul 26 14:56:07.603666 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 6/10] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:08.252885 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-7302532f-ae9a-4a2a-aace-00400150baf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:08.379386 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-7302532f-ae9a-4a2a-aace-00400150baf0 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.767523 Jul 26 14:56:08.379386 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 5/11] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:08.392336 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-56817d50-0fe2-4b59-8b0e-6349426a9f20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:08.525385 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-56817d50-0fe2-4b59-8b0e-6349426a9f20 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137372 Jul 26 14:56:08.526292 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 7/12] 10.222.0.94 () {64 vars in 1335 bytes} [Tue Jul 26 14:56:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:11.084648 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-7302532f-ae9a-4a2a-aace-00400150baf0 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:11.085837 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-7302532f-ae9a-4a2a-aace-00400150baf0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 26 14:56:11.086340 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 6/13] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:11.815165 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-1c4bee40-9d2c-4652-9421-320d1803acae admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:11.917891 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-1c4bee40-9d2c-4652-9421-320d1803acae admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.823891 Jul 26 14:56:11.918818 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 8/14] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:56:11.933472 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-25d5fd5c-bfc2-47ec-b237-36767d61b55f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:12.062211 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-25d5fd5c-bfc2-47ec-b237-36767d61b55f admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132496 Jul 26 14:56:12.063265 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 7/15] 10.222.0.94 () {64 vars in 1335 bytes} [Tue Jul 26 14:56:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:14.795625 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-1c4bee40-9d2c-4652-9421-320d1803acae admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:14.796785 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-1c4bee40-9d2c-4652-9421-320d1803acae admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jul 26 14:56:14.797281 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 9/16] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:56:15.396729 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-68a0182d-19da-4250-986b-7bbe85e17a42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:15.506633 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-68a0182d-19da-4250-986b-7bbe85e17a42 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702136 Jul 26 14:56:15.507976 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 8/17] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:15.525762 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-6af1907e-6d31-48c7-b7d9-524edbd918b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:15.661200 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-6af1907e-6d31-48c7-b7d9-524edbd918b9 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139143 Jul 26 14:56:15.661787 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 10/18] 10.222.0.94 () {64 vars in 1335 bytes} [Tue Jul 26 14:56:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:18.298598 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-68a0182d-19da-4250-986b-7bbe85e17a42 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:18.299956 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-68a0182d-19da-4250-986b-7bbe85e17a42 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001872 Jul 26 14:56:18.300784 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 9/19] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:56:18.917742 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-eb9a82fa-55e1-40c0-bd73-c09bd472c949 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:18.953024 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-eb9a82fa-55e1-40c0-bd73-c09bd472c949 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.643631 Jul 26 14:56:18.953589 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 11/20] 10.222.0.94 () {60 vars in 1291 bytes} [Tue Jul 26 14:56:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:56:21.698376 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-68a0182d-19da-4250-986b-7bbe85e17a42 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:21.700275 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-68a0182d-19da-4250-986b-7bbe85e17a42 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002664 Jul 26 14:56:21.701642 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 10/21] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:22.347745 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-1e186706-b581-4191-ba99-bd889bb73422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "1"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:22.464251 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-1e186706-b581-4191-ba99-bd889bb73422 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.751042 Jul 26 14:56:22.465164 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 12/22] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:22.479137 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-52e55f21-40e1-47be-b285-2c4170f7b885 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:22.641010 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-52e55f21-40e1-47be-b285-2c4170f7b885 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165600 Jul 26 14:56:22.641860 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 11/23] 10.222.0.94 () {64 vars in 1332 bytes} [Tue Jul 26 14:56:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:25.124250 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-1e186706-b581-4191-ba99-bd889bb73422 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:25.125351 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-1e186706-b581-4191-ba99-bd889bb73422 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Jul 26 14:56:25.125836 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 13/24] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:25.762893 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-7ece7fef-246e-4c90-8406-0f03395745a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:25.770782 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:25.876182 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-7ece7fef-246e-4c90-8406-0f03395745a5 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.742947 Jul 26 14:56:25.880755 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 12/25] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:56:25.893323 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-d94344f8-39f5-45c2-82c0-784bb100be31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:26.002888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-d94344f8-39f5-45c2-82c0-784bb100be31 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114834 Jul 26 14:56:26.004000 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 14/26] 10.222.0.94 () {64 vars in 1332 bytes} [Tue Jul 26 14:56:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:28.680840 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-7ece7fef-246e-4c90-8406-0f03395745a5 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:28.681868 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-7ece7fef-246e-4c90-8406-0f03395745a5 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 26 14:56:28.682291 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 13/27] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:29.238074 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-204129cf-fa4d-410e-98fb-3969598dddf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "rxtx_factor": 1.0}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:29.365706 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-204129cf-fa4d-410e-98fb-3969598dddf9 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.674471 Jul 26 14:56:29.366780 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 15/28] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:29.385451 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-978d9239-86ef-47b0-9707-149f0ce6a041 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:29.467380 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-978d9239-86ef-47b0-9707-149f0ce6a041 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086647 Jul 26 14:56:29.468577 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 14/29] 10.222.0.94 () {64 vars in 1332 bytes} [Tue Jul 26 14:56:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:32.167727 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-204129cf-fa4d-410e-98fb-3969598dddf9 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:32.169465 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-204129cf-fa4d-410e-98fb-3969598dddf9 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 26 14:56:32.176490 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 16/30] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:32.871534 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-8b30c4bc-71ed-48a4-8970-436d3d9ca5d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:32.992669 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-8b30c4bc-71ed-48a4-8970-436d3d9ca5d9 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.813795 Jul 26 14:56:32.993790 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 15/31] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:33.014071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-ed4685ec-f7d3-4a73-b501-42c09704f37c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:33.033534 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.126544 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-ed4685ec-f7d3-4a73-b501-42c09704f37c admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119392 Jul 26 14:56:33.139498 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 17/32] 10.222.0.94 () {64 vars in 1332 bytes} [Tue Jul 26 14:56:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:35.931866 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-8b30c4bc-71ed-48a4-8970-436d3d9ca5d9 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:35.933743 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-8b30c4bc-71ed-48a4-8970-436d3d9ca5d9 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002518 Jul 26 14:56:35.935279 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 16/33] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:36.623398 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-037166c5-eee8-4d50-82ef-3e8340587250 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:36.769434 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-037166c5-eee8-4d50-82ef-3e8340587250 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.823430 Jul 26 14:56:36.770634 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 18/34] 10.222.0.94 () {64 vars in 1282 bytes} [Tue Jul 26 14:56:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:56:36.786173 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-626c822b-e36a-4c89-bd51-8e64819a0a85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:36.884465 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-626c822b-e36a-4c89-bd51-8e64819a0a85 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103232 Jul 26 14:56:36.886334 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 17/35] 10.222.0.94 () {64 vars in 1332 bytes} [Tue Jul 26 14:56:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:00.185756 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-037166c5-eee8-4d50-82ef-3e8340587250 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:00.187063 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-037166c5-eee8-4d50-82ef-3e8340587250 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002322 Jul 26 14:57:00.187796 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 19/36] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:57:00.200666 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:00.693892 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-f523ca8e-b98c-4bd2-b29b-b1c087d39c67 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:00.714467 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-f523ca8e-b98c-4bd2-b29b-b1c087d39c67 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.519014 Jul 26 14:57:00.715025 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 18/37] 10.222.0.94 () {60 vars in 1291 bytes} [Tue Jul 26 14:57:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:57:01.917412 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-037166c5-eee8-4d50-82ef-3e8340587250 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:01.919225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-037166c5-eee8-4d50-82ef-3e8340587250 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Jul 26 14:57:01.919772 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 20/38] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:02.525489 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-c2cf75e2-5cea-44ff-8ec2-0f60c51a64dd admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:02.532045 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.wsgi [None req-c2cf75e2-5cea-44ff-8ec2-0f60c51a64dd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-c2cf75e2-5cea-44ff-8ec2-0f60c51a64dd admin admin] Request method failure captured: Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Accept: application/json Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Accept-Encoding: gzip, deflate Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Connection: keep-alive Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Content-Length: 0 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Host: 10.222.0.94 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Openstack-Api-Version: compute 2.90 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Openstack-System-Scope: None Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: User-Agent: python-novaclient Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Auth-Token: gAAAAABi4AC9mqchfE8IQCq-xV9GipzpT47MNRrCMvdGbGV1yazOT0LwUUgT1hwyJgQVW18253GyVD-xjRhzG_j7Pl4WbA7gGZcPdaG8-XA8DILB7KnQKr-dhbwxTXMmAj7LfRHYmG2XRCtmp_uEKJaECi5Xmu1VedjkHNwED5sCuHemv3m1SN8 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Domain-Id: None Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Domain-Name: None Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Identity-Status: Confirmed Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Is-Admin-Project: True Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Domain-Id: default Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Domain-Name: Default Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Name: admin Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Role: reader,admin,member Jul 26 14:57:02.535281 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Roles: reader,admin,member Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant: admin Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant-Name: admin Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User: admin Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Domain-Id: default Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Domain-Name: Default Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Id: 31dac45eb8764daf9a148a750fdc78a0 Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Name: admin Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: method: > Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: exception: Flavor 42 could not be found. Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: action_args: {'id': '42'} Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:57:02.536904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:02.538143 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.539660 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-c2cf75e2-5cea-44ff-8ec2-0f60c51a64dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:57:02.541048 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-c2cf75e2-5cea-44ff-8ec2-0f60c51a64dd admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.474048 Jul 26 14:57:02.541048 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 19/39] 10.222.0.94 () {60 vars in 1190 bytes} [Tue Jul 26 14:57:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:02.546580 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-09913b66-6ccf-428a-9bc4-013fe367f729 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:02.550864 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:02.571402 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-09913b66-6ccf-428a-9bc4-013fe367f729 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028262 Jul 26 14:57:02.572018 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 21/40] 10.222.0.94 () {60 vars in 1210 bytes} [Tue Jul 26 14:57:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:57:02.583800 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-8e6fc545-5e17-4a87-98d6-6e37f423ae18 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:02.610472 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-8e6fc545-5e17-4a87-98d6-6e37f423ae18 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030531 Jul 26 14:57:02.611115 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 20/41] 10.222.0.94 () {60 vars in 1210 bytes} [Tue Jul 26 14:57:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:57:02.622913 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-b5edc8f4-1d38-4f82-94e6-89f3e522f0ea admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:02.631902 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.wsgi [None req-b5edc8f4-1d38-4f82-94e6-89f3e522f0ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-b5edc8f4-1d38-4f82-94e6-89f3e522f0ea admin admin] Request method failure captured: Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Accept: application/json Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Accept-Encoding: gzip, deflate Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Connection: keep-alive Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Content-Length: 0 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Host: 10.222.0.94 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Openstack-Api-Version: compute 2.90 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Openstack-System-Scope: None Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: User-Agent: python-novaclient Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Auth-Token: gAAAAABi4AC9mqchfE8IQCq-xV9GipzpT47MNRrCMvdGbGV1yazOT0LwUUgT1hwyJgQVW18253GyVD-xjRhzG_j7Pl4WbA7gGZcPdaG8-XA8DILB7KnQKr-dhbwxTXMmAj7LfRHYmG2XRCtmp_uEKJaECi5Xmu1VedjkHNwED5sCuHemv3m1SN8 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Domain-Id: None Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Domain-Name: None Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Identity-Status: Confirmed Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Is-Admin-Project: True Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Domain-Id: default Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Domain-Name: Default Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Name: admin Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Role: reader,admin,member Jul 26 14:57:02.637175 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Roles: reader,admin,member Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant: admin Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant-Name: admin Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User: admin Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Domain-Id: default Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Domain-Name: Default Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Id: 31dac45eb8764daf9a148a750fdc78a0 Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Name: admin Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: method: > Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: exception: Flavor 42 could not be found. Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: action_args: {'id': '42'} Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:57:02.646071 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:02.647932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:02.650408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-b5edc8f4-1d38-4f82-94e6-89f3e522f0ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:57:02.653368 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-b5edc8f4-1d38-4f82-94e6-89f3e522f0ea admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021546 Jul 26 14:57:02.653368 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 22/42] 10.222.0.94 () {60 vars in 1190 bytes} [Tue Jul 26 14:57:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:03.985452 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-8e6fc545-5e17-4a87-98d6-6e37f423ae18 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:03.986478 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-8e6fc545-5e17-4a87-98d6-6e37f423ae18 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 26 14:57:03.986891 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 21/43] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:57:04.632878 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-2e1e072f-8916-41d8-9573-5040da1a7a62 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:04.639291 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.wsgi [None req-2e1e072f-8916-41d8-9573-5040da1a7a62 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-2e1e072f-8916-41d8-9573-5040da1a7a62 admin admin] Request method failure captured: Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Accept: application/json Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Accept-Encoding: gzip, deflate Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Connection: keep-alive Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Content-Length: 0 Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Host: 10.222.0.94 Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Openstack-Api-Version: compute 2.90 Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Openstack-System-Scope: None Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: User-Agent: python-novaclient Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Auth-Token: gAAAAABi4AC_d498nMWhj4DYNlqb9iepvZR_TwMUcv0NH_OV6t2mwNmUedSkqWL6hZdr-FCIL5YNX8kKwtfpKz68D_TcxqyxSs_wVztUWy9iL6cHBapwo4BP1gg5YnJmudpwZ_IsbNZbO_O1_-I7QkMORwTcdjBP-LsaffBuGNKEvbyiQezoktc Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Domain-Id: None Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Domain-Name: None Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Identity-Status: Confirmed Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Is-Admin-Project: True Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Domain-Id: default Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Domain-Name: Default Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Name: admin Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Role: reader,admin,member Jul 26 14:57:04.640888 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Roles: reader,admin,member Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant: admin Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant-Name: admin Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User: admin Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Domain-Id: default Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Domain-Name: Default Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Id: 31dac45eb8764daf9a148a750fdc78a0 Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Name: admin Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: method: > Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: exception: Flavor 84 could not be found. Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: action_args: {'id': '84'} Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:57:04.642230 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:04.643193 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.644532 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-2e1e072f-8916-41d8-9573-5040da1a7a62 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:57:04.645739 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-2e1e072f-8916-41d8-9573-5040da1a7a62 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.508633 Jul 26 14:57:04.645739 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 23/44] 10.222.0.94 () {60 vars in 1190 bytes} [Tue Jul 26 14:57:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 510 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 14:57:04.652821 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-bc75d151-d860-43b5-bc4b-24b9b693e10e admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:04.668524 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-bc75d151-d860-43b5-bc4b-24b9b693e10e admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019767 Jul 26 14:57:04.669107 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 22/45] 10.222.0.94 () {60 vars in 1210 bytes} [Tue Jul 26 14:57:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:57:04.679441 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-287e81e8-6756-4a80-b5f8-8df57b7a84e0 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:04.697352 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-287e81e8-6756-4a80-b5f8-8df57b7a84e0 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021658 Jul 26 14:57:04.697987 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 24/46] 10.222.0.94 () {60 vars in 1210 bytes} [Tue Jul 26 14:57:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:57:04.710493 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-56bd6a3d-74d7-480c-937a-d911e3a5140d admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:04.717246 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.wsgi [None req-56bd6a3d-74d7-480c-937a-d911e3a5140d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-56bd6a3d-74d7-480c-937a-d911e3a5140d admin admin] Request method failure captured: Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Accept: application/json Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Accept-Encoding: gzip, deflate Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Connection: keep-alive Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Content-Length: 0 Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Host: 10.222.0.94 Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Openstack-Api-Version: compute 2.90 Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Openstack-System-Scope: None Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: User-Agent: python-novaclient Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Auth-Token: gAAAAABi4AC_d498nMWhj4DYNlqb9iepvZR_TwMUcv0NH_OV6t2mwNmUedSkqWL6hZdr-FCIL5YNX8kKwtfpKz68D_TcxqyxSs_wVztUWy9iL6cHBapwo4BP1gg5YnJmudpwZ_IsbNZbO_O1_-I7QkMORwTcdjBP-LsaffBuGNKEvbyiQezoktc Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Domain-Id: None Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Domain-Name: None Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Identity-Status: Confirmed Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Is-Admin-Project: True Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Domain-Id: default Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Domain-Name: Default Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Name: admin Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Role: reader,admin,member Jul 26 14:57:04.718799 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Roles: reader,admin,member Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant: admin Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant-Name: admin Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User: admin Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Domain-Id: default Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Domain-Name: Default Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Id: 31dac45eb8764daf9a148a750fdc78a0 Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Name: admin Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: method: > Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: exception: Flavor 84 could not be found. Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: action_args: {'id': '84'} Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:57:04.720323 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:04.721278 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:04.722981 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-56bd6a3d-74d7-480c-937a-d911e3a5140d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:57:04.724479 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-56bd6a3d-74d7-480c-937a-d911e3a5140d admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013570 Jul 26 14:57:04.724479 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 23/47] 10.222.0.94 () {60 vars in 1190 bytes} [Tue Jul 26 14:57:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 14:57:05.812792 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-287e81e8-6756-4a80-b5f8-8df57b7a84e0 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:05.814188 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-287e81e8-6756-4a80-b5f8-8df57b7a84e0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Jul 26 14:57:05.814710 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 25/48] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:06.509756 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-359578cb-4d03-480f-a234-eb0119264901 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:06.518080 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.wsgi [None req-359578cb-4d03-480f-a234-eb0119264901 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-359578cb-4d03-480f-a234-eb0119264901 admin admin] Request method failure captured: Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Accept: application/json Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Accept-Encoding: gzip, deflate Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Connection: keep-alive Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Content-Length: 0 Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Host: 10.222.0.94 Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Openstack-Api-Version: compute 2.90 Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Openstack-System-Scope: None Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: User-Agent: python-novaclient Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Auth-Token: gAAAAABi4ADBDZjaQZzNhxreJIN1wI5j_abMwyDYPuQSKoxcQSlouE9WB_etg6eRq_JtZBaSCG1uOPJ_Ks0Q7WAgmDkN3bW8EOZJoEjK6yVCY1ObvGpK8vBdsqHIFfFpdCmwaZMlTWRcIE727HnI8uNutRu6vsvWubqhx1OjQcr1GLsP3SvE1AE Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Domain-Id: None Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Domain-Name: None Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Identity-Status: Confirmed Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Is-Admin-Project: True Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Domain-Id: default Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Domain-Name: Default Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Project-Name: admin Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Role: reader,admin,member Jul 26 14:57:06.519966 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Roles: reader,admin,member Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant: admin Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-Tenant-Name: admin Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User: admin Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Domain-Id: default Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Domain-Name: Default Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Id: 31dac45eb8764daf9a148a750fdc78a0 Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: X-User-Name: admin Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: method: > Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: exception: Flavor 451 could not be found. Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: action_args: {'id': '451'} Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:57:06.522401 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:06.524441 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.527037 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-359578cb-4d03-480f-a234-eb0119264901 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:57:06.529259 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-359578cb-4d03-480f-a234-eb0119264901 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.531499 Jul 26 14:57:06.529259 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 24/49] 10.222.0.94 () {60 vars in 1193 bytes} [Tue Jul 26 14:57:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 533 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:06.534678 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-6da3c8fd-f23e-4cb3-8e5c-0e67f718a8a9 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:06.550796 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-6da3c8fd-f23e-4cb3-8e5c-0e67f718a8a9 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020014 Jul 26 14:57:06.551406 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 26/50] 10.222.0.94 () {60 vars in 1210 bytes} [Tue Jul 26 14:57:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:57:06.561937 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:06.579109 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021223 Jul 26 14:57:06.579710 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 25/51] 10.222.0.94 () {60 vars in 1210 bytes} [Tue Jul 26 14:57:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:57:06.589932 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-32d4f6cf-ce20-4c23-8fd5-1d8bdfc6c513 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:06.595873 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.wsgi [None req-32d4f6cf-ce20-4c23-8fd5-1d8bdfc6c513 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-32d4f6cf-ce20-4c23-8fd5-1d8bdfc6c513 admin admin] Request method failure captured: Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Accept: application/json Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Accept-Encoding: gzip, deflate Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Connection: keep-alive Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Content-Length: 0 Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Host: 10.222.0.94 Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Openstack-Api-Version: compute 2.90 Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Openstack-System-Scope: None Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: User-Agent: python-novaclient Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Auth-Token: gAAAAABi4ADBDZjaQZzNhxreJIN1wI5j_abMwyDYPuQSKoxcQSlouE9WB_etg6eRq_JtZBaSCG1uOPJ_Ks0Q7WAgmDkN3bW8EOZJoEjK6yVCY1ObvGpK8vBdsqHIFfFpdCmwaZMlTWRcIE727HnI8uNutRu6vsvWubqhx1OjQcr1GLsP3SvE1AE Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Domain-Id: None Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Domain-Name: None Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Identity-Status: Confirmed Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Is-Admin-Project: True Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Domain-Id: default Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Domain-Name: Default Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Project-Name: admin Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Role: reader,admin,member Jul 26 14:57:06.597389 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Roles: reader,admin,member Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/382829af20d649b9beb375e3c3cc2d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant: admin Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant-Id: 382829af20d649b9beb375e3c3cc2d50 Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-Tenant-Name: admin Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User: admin Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Domain-Id: default Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Domain-Name: Default Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Id: 31dac45eb8764daf9a148a750fdc78a0 Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: X-User-Name: admin Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: method: > Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: exception: Flavor 451 could not be found. Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: action_args: {'id': '451'} Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:57:06.599225 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:06.600408 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: ERROR nova.api.openstack.wsgi Jul 26 14:57:06.602055 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-32d4f6cf-ce20-4c23-8fd5-1d8bdfc6c513 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:57:06.603739 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-32d4f6cf-ce20-4c23-8fd5-1d8bdfc6c513 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012999 Jul 26 14:57:06.603739 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 27/52] 10.222.0.94 () {60 vars in 1193 bytes} [Tue Jul 26 14:57:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:07.613928 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:07.615307 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002887 Jul 26 14:57:07.615785 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 26/53] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:08.195849 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-d5eeba66-864e-465a-b25d-f62a974e001e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:08.405464 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-d5eeba66-864e-465a-b25d-f62a974e001e admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.647432 Jul 26 14:57:08.405978 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 28/54] 10.222.0.94 () {64 vars in 1235 bytes} [Tue Jul 26 14:57:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:09.448489 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:09.449524 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 26 14:57:09.449988 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 27/55] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:10.063350 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-4da43fae-4bfb-4ba6-900a-69fefd3622b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:10.205768 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-4da43fae-4bfb-4ba6-900a-69fefd3622b5 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.615472 Jul 26 14:57:10.206399 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 29/56] 10.222.0.94 () {64 vars in 1235 bytes} [Tue Jul 26 14:57:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:11.401311 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:11.403131 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Jul 26 14:57:11.403843 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 28/57] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:12.224690 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-9f7e461e-77e1-4a50-8d8f-27d6e7ba8c4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:12.316112 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-9f7e461e-77e1-4a50-8d8f-27d6e7ba8c4d admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.758582 Jul 26 14:57:12.316786 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 30/58] 10.222.0.94 () {64 vars in 1235 bytes} [Tue Jul 26 14:57:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:13.383062 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:13.384095 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 26 14:57:13.384492 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 29/59] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:13.976090 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-99b0644f-6fb2-465c-b8ba-0d575ea6c9eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:14.056118 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-99b0644f-6fb2-465c-b8ba-0d575ea6c9eb admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.525868 Jul 26 14:57:14.056697 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 31/60] 10.222.0.94 () {64 vars in 1235 bytes} [Tue Jul 26 14:57:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:15.131243 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:15.132318 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 26 14:57:15.132716 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 30/61] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 14:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:15.765100 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-b5b1583b-52ee-4318-9977-b9530d129c84 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:15.787729 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-b5b1583b-52ee-4318-9977-b9530d129c84 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.509721 Jul 26 14:57:15.788306 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 32/62] 10.222.0.94 () {60 vars in 1202 bytes} [Tue Jul 26 14:57:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:58:14.502070 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:14.503188 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-1deafe13-108a-478c-9550-f98c539e9125 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Jul 26 14:58:14.503754 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 31/63] 10.222.0.94 () {54 vars in 930 bytes} [Tue Jul 26 14:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:58:14.517605 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:15.070309 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-0fbc6597-1ff4-4537-bebd-da17ba0158e3 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.095135 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-0fbc6597-1ff4-4537-bebd-da17ba0158e3 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.583467 Jul 26 14:58:15.095756 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 33/64] 10.222.0.94 () {60 vars in 1291 bytes} [Tue Jul 26 14:58:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:58:15.123092 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-3ec9f098-c7c1-4a0e-8c4a-23ca6a0de946 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.131333 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG dbcounter [-] [115649] Writing DB stats nova_api:SELECT=14 {{(pid=115649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:15.143570 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-3ec9f098-c7c1-4a0e-8c4a-23ca6a0de946 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.024902 Jul 26 14:58:15.149060 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 32/65] 10.222.0.94 () {60 vars in 1282 bytes} [Tue Jul 26 14:58:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:15.159406 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-2d9f8792-a5c7-4856-822a-e3250e0dde93 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.169930 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-2d9f8792-a5c7-4856-822a-e3250e0dde93 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014400 Jul 26 14:58:15.170661 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 34/66] 10.222.0.94 () {60 vars in 1285 bytes} [Tue Jul 26 14:58:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:15.185191 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.194259 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014454 Jul 26 14:58:15.194943 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 33/67] 10.222.0.94 () {60 vars in 1285 bytes} [Tue Jul 26 14:58:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:15.209319 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-b922b8ca-ec9d-49ff-bdd8-2882e0900d94 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.219500 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-b922b8ca-ec9d-49ff-bdd8-2882e0900d94 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014296 Jul 26 14:58:15.220093 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 35/68] 10.222.0.94 () {60 vars in 1282 bytes} [Tue Jul 26 14:58:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:34.546904 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:34.548314 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jul 26 15:02:34.549001 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 34/69] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 15:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:34.706692 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_api:SELECT=6 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:34.877899 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-3bf39dfc-95f5-41e3-8161-8a96870384c8 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:34.880349 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:02:34.880349 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: warnings.warn(msg) Jul 26 15:02:34.881614 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-3bf39dfc-95f5-41e3-8161-8a96870384c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:34.882063 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-3bf39dfc-95f5-41e3-8161-8a96870384c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:34.882850 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-3bf39dfc-95f5-41e3-8161-8a96870384c8 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:34.883281 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-3bf39dfc-95f5-41e3-8161-8a96870384c8 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:34.918195 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-3bf39dfc-95f5-41e3-8161-8a96870384c8 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.213856 Jul 26 15:02:34.918774 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 36/70] 10.222.0.94 () {60 vars in 1193 bytes} [Tue Jul 26 15:02:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:02:35.818536 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:35.820411 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002987 Jul 26 15:02:35.820886 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 35/71] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 15:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:36.040934 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-11e70f5a-b5de-4baa-838b-45d1839eeed3 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:36.043659 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:02:36.043659 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: warnings.warn(msg) Jul 26 15:02:36.044959 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-11e70f5a-b5de-4baa-838b-45d1839eeed3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:36.045409 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-11e70f5a-b5de-4baa-838b-45d1839eeed3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:36.046769 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-11e70f5a-b5de-4baa-838b-45d1839eeed3 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:36.046769 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-11e70f5a-b5de-4baa-838b-45d1839eeed3 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:36.068327 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-11e70f5a-b5de-4baa-838b-45d1839eeed3 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.101903 Jul 26 15:02:36.068936 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 37/72] 10.222.0.94 () {60 vars in 1193 bytes} [Tue Jul 26 15:02:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:02:47.545211 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:47.546216 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 26 15:02:47.546619 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 36/73] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 15:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:47.699200 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_cell0:SELECT=4 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:47.700289 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_cell1:SELECT=4 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:47.701130 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG dbcounter [-] [115648] Writing DB stats nova_api:SELECT=8 {{(pid=115648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:47.758507 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-71cf6603-c7c2-4c74-9ef6-2937af7f7696 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:47.766857 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:02:47.766857 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: warnings.warn(msg) Jul 26 15:02:47.766857 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-71cf6603-c7c2-4c74-9ef6-2937af7f7696 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:47.766857 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-71cf6603-c7c2-4c74-9ef6-2937af7f7696 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:47.766857 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-71cf6603-c7c2-4c74-9ef6-2937af7f7696 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:47.766857 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-71cf6603-c7c2-4c74-9ef6-2937af7f7696 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:47.810271 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-71cf6603-c7c2-4c74-9ef6-2937af7f7696 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.116019 Jul 26 15:02:47.811183 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 38/74] 10.222.0.94 () {60 vars in 1193 bytes} [Tue Jul 26 15:02:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:48.751692 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: DEBUG nova.api.openstack.wsgi [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] Calling method '>' {{(pid=115649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:48.753703 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: INFO nova.api.openstack.requestlog [None req-07eb82bd-064f-4b0d-867b-1748fd51e2a3 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002746 Jul 26 15:02:48.754415 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: [pid: 115649|app: 0|req: 37/75] 10.222.0.94 () {56 vars in 1074 bytes} [Tue Jul 26 15:02:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:49.084764 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG nova.api.openstack.wsgi [None req-1ddf4243-fb05-4cdf-9278-5076ffd52574 admin admin] Calling method '>' {{(pid=115648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:49.087506 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:02:49.087506 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: warnings.warn(msg) Jul 26 15:02:49.088866 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-1ddf4243-fb05-4cdf-9278-5076ffd52574 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:49.089322 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-1ddf4243-fb05-4cdf-9278-5076ffd52574 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.090197 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-1ddf4243-fb05-4cdf-9278-5076ffd52574 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:49.090719 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: DEBUG oslo_concurrency.lockutils [None req-1ddf4243-fb05-4cdf-9278-5076ffd52574 admin admin] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.114827 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: INFO nova.api.openstack.requestlog [None req-1ddf4243-fb05-4cdf-9278-5076ffd52574 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090875 Jul 26 15:02:49.115418 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: [pid: 115648|app: 0|req: 39/76] 10.222.0.94 () {60 vars in 1193 bytes} [Tue Jul 26 15:02:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:49.441285 dv-cinder-850668-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 15:03:49.442267 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: Tue Jul 26 15:03:49 2022 - graceful shutdown triggered... Jul 26 15:03:49.442793 dv-cinder-850668-2-iscsi devstack@n-api.service[115649]: Gracefully killing worker 2 (pid: 115649)... Jul 26 15:03:49.443245 dv-cinder-850668-2-iscsi devstack@n-api.service[115648]: Gracefully killing worker 1 (pid: 115648)... Jul 26 15:03:50.443425 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: worker 1 buried after 1 seconds Jul 26 15:03:50.443425 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: worker 2 buried after 1 seconds Jul 26 15:03:50.444104 dv-cinder-850668-2-iscsi devstack@n-api.service[115647]: goodbye to uWSGI. Jul 26 15:03:50.445144 dv-cinder-850668-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 15:03:50.445692 dv-cinder-850668-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 15:03:50.448580 dv-cinder-850668-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 15:03:50.460339 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 15:03:50.462980 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 15:03:50 2022] *** Jul 26 15:03:50.463142 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 15:03:50.463259 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 15:03:50.463375 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: nodename: dv-cinder-850668-2-iscsi Jul 26 15:03:50.463501 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: machine: x86_64 Jul 26 15:03:50.463619 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: clock source: unix Jul 26 15:03:50.463730 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: pcre jit disabled Jul 26 15:03:50.463840 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: detected number of CPU cores: 4 Jul 26 15:03:50.463962 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: current working directory: / Jul 26 15:03:50.464073 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: detected binary path: /usr/bin/uwsgi-core Jul 26 15:03:50.464196 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: your processes number limit is 47680 Jul 26 15:03:50.464320 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: your memory page size is 4096 bytes Jul 26 15:03:50.464433 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: detected max file descriptor number: 2048 Jul 26 15:03:50.464545 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: lock engine: pthread robust mutexes Jul 26 15:03:50.464845 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: thunder lock: enabled Jul 26 15:03:50.465031 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 15:03:50.465131 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 15:03:50.506225 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: Python main interpreter initialized at 0x55b4b51e59c0 Jul 26 15:03:50.506225 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: python threads support enabled Jul 26 15:03:50.506225 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: your server socket listen backlog is limited to 100 connections Jul 26 15:03:50.506225 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: your mercy for graceful operations on workers is 90 seconds Jul 26 15:03:50.506648 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 15:03:50.506648 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: *** Operational MODE: preforking *** Jul 26 15:03:50.506903 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: *** uWSGI is running in multiple interpreter mode *** Jul 26 15:03:50.506903 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: spawned uWSGI master process (pid: 130745) Jul 26 15:03:50.507117 dv-cinder-850668-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 15:03:50.507727 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: spawned uWSGI worker 1 (pid: 130762, cores: 1) Jul 26 15:03:50.508228 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: spawned uWSGI worker 2 (pid: 130764, cores: 1) Jul 26 15:03:50.508529 dv-cinder-850668-2-iscsi devstack@n-api.service[130745]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 15:03:51.192084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 15:03:51.194767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 15:03:52.393718 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:03:52.393718 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: from cryptography.utils import int_from_bytes Jul 26 15:03:52.394488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:03:52.394488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: from cryptography.utils import int_from_bytes Jul 26 15:03:52.411489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:03:52.411489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: from cryptography.utils import int_from_bytes Jul 26 15:03:52.412174 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:03:52.412174 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: from cryptography.utils import int_from_bytes Jul 26 15:03:54.861186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:03:54.861763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:03:54.861998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:03:54.862364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:03:54.862626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:03:54.863024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.863353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.863706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.864028 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.864361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.864674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.865077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.865406 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.865739 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.866004 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.866327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.866653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850668-2-iscsi {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.866979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.867516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.867840 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.868329 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.868489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.868788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.869094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.869752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.870056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.870378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.870926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.871150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.871337 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.871705 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.872016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.872389 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.872807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.873192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.873590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850668-2-iscsi {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.873915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.874233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.874551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.874979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.875290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.875897 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.876205 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.876551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.876866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.877197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.877516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.877840 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.878169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.878460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.878849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.879084 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.879405 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.879745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.880051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.880303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.880614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.880943 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.881263 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.881587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.881841 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.882100 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.882423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.882745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.883075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.883361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.883694 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.884000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.884436 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.884608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.884906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.885211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.885534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.885889 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.886180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.886486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.886804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.887211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.887496 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.887792 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.888168 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.888489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.888799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.889122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.889443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.889751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.890072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.890376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.890709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.891033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.891378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.891884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.892055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.892306 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.892633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.892946 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.893234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.894913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.894913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.894913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.894913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.894913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.897242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.899404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.900583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.900583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.900583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.900583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.901515 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.901515 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.901515 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.902550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.902550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.902550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.902814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.902945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.903253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.904210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.904507 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.904817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.905106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.905417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.905703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.906123 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.906359 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.906688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.906960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.907269 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.910636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.912469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.913708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.913708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.913708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.913708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.914477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.914477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.914771 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.914935 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.915272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.915605 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.915823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.916184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.916576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.916817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.917132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.917457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.917774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.918089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.918513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.918748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.919055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.920440 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.920762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.921254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.921506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.922796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.922796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.922796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.922796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.923082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.923307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.923610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.923927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.924242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.924570 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.924868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.925184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.925490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.925806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.926116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.926441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.926779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.927091 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.927438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.927775 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.928092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.928407 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.928723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.929033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.929352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.935893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.937119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.938187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.938187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.938187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.938187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.938725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.938725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.939019 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.939169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.939919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.939919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.940261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.940412 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.941464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.941464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.941464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.942092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.942092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.942485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.942819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.943148 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.943594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.943811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.944130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.944446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.944760 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.945075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.945398 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.945762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.946030 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.946385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.946720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.947033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.947362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.947717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.948043 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.948391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.948731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.949052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.949377 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.950109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.950109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.950955 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.951116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.951981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.951981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.952360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.952360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.952668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.953002 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.953307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.953619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.953944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.954254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.954577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.954912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.955248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.955587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.955907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.956231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.956547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.956863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.957309 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.957479 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.957789 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.958104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.958419 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.958734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.959047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.959354 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.959724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.960474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.960474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.960776 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.960928 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.961241 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.961553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.961911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.962195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.962504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.962814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.963279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.963547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.963847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.964106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.964388 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.964656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:03:54.965216 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.965390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:03:54.965751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.965751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.966096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:03:54.966780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.966996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:03:54.967241 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.967595 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:03:54.967849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.968046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.968193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.968336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.968504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.968649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.968868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.969045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.969254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.969431 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.969623 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.969782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.969961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.970277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.970876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.971131 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.971376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.971697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.972004 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.972492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.972745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.972991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.973248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.974097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850668-2-iscsi {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.974362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.974601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.974837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.974837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.975283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.975587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.975837 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.976073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.976318 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.976556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.976810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.976810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.977183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.977378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.977548 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.977548 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.977827 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.978012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.978164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.978164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.978450 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.978594 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.978752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.978752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.979046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.979190 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.979339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.979339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.979681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.979681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.979982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.980132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.980410 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.980691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.981165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.981326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.981470 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.982146 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.982349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850668-2-iscsi {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.982809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.982809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.983268 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.983540 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.983846 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.984007 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.984306 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.984463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.984607 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.984766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.984911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.985054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.985204 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.985347 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.985489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.985640 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.985812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.985957 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.986108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.986250 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.986501 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.986658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.986818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.986978 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.987137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.987295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.987454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.987661 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.987833 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.987984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.987984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.988276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.988435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.988593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.988751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.988909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.989067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.989219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.989377 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.989535 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.989685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.989844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.989995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.990155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.990314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.990580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.990880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.991366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.991556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.991731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.991731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.992021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.992169 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.992332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.992490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.992658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.993002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.993168 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.993328 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.993484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.993648 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.993798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.994089 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.994245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.994404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.994692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.994692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.995006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.995163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.995312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.995489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.995645 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.995807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.995956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.996105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.996261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.996410 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.996584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.996757 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.996908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.997066 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.997234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.997997 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.998209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.998463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.998715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.999017 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.999204 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.999363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.999601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:54.999780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:54.999939 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.000091 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.000240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.000668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.001037 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.001506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.001670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.001831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.001831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.002200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.002353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.002502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.002672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.002832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.003185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.003358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.003567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.003755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.003908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.004093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.004363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.004529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.004529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.004947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.005101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.005263 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.005421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.005584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.005584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.005878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.005878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.006177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.006336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.006486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.006642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.006803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.006954 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.007103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.007272 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.007421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.007421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.007772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.007929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.008089 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.008248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.008398 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.008548 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.008709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.008866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.009016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.009175 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.009175 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.009489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.009662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.009836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.009997 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.010148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.010297 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.010446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.010603 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.010760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.010939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.011314 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.011791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.011951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.012101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.012265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.012431 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.012581 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.012738 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.012914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.013086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.013580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.013847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.014090 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.014257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.014582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.014741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.014892 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.015201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.015367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.015574 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.015741 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.015907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.016065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.016223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.016374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.016535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.016696 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.016864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.017014 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.017163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.017312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.017478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.017637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.017795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.017952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.018108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.018267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.018427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.018578 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.018728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.018895 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.019046 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.019194 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.019357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.019528 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.019684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.019832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.019992 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.020151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.020301 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.020449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.020599 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.020755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.020922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.021081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.021461 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.021639 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.022112 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.022290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.022563 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.022744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.022905 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.023061 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:03:55.023211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.023377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.023839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.024012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.024172 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.024322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.024471 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.024848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.025017 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.025197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.025525 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.025699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.025864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.025864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.026163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.026333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.026494 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.026645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.026795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.026945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.027108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.027266 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.027416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.027589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.027750 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.027750 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.028053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.028221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.028379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.028541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.028699 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.028880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.029122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.029378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.029641 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.029861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030027 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030494 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.030961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.031130 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.031282 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.031450 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.031877 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.032327 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.032489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.032655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.032808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.032808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.033106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.033270 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.033434 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.033592 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.033768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.034113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.034291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.034501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.034663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.034841 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.035136 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.035293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.035443 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.035758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.035941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.036093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.036253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.036417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.036575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.036734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.036885 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037034 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.037965 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.038122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.038279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.038439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.038602 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.038761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.038910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.039067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.039225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.039382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.039589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.039743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.039902 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.040060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.040217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.040376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.040534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.040740 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.040898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.041048 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.041205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.041444 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.041597 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.041980 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.042156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.042770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.042942 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.043107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.043260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.043419 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.043609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.043766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.043928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.044852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.045062 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.045501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.045776 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.046141 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.046325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.046486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.046646 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.046800 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.046950 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.047101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.047261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.047412 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.047589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.047752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.047905 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048388 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048538 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.048999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.049163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.049314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.049475 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.049633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.049783 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.049944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.050103 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.050272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.050423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.050573 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.050723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.050960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.051128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.051333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.051553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.051712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.051888 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.052360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.052546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.053068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.053252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.053413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.053571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.053736 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.053893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.054050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.054201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.054360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.054520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.054671 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.055057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.055223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.055382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.055717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.055717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.056042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.056042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.056491 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.056641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.056800 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.056961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.057120 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.057271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.057430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.057587 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.057765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.057765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.058063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.058063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.058430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.058588 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.058748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.058898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.059047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.059202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.059361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.059549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.059728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.059941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.060594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.060857 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.061101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.061356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.061625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.061826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.061996 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.062169 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.062547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.062715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.063258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.063427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.063736 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.063904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.064058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.064058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.064514 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.064677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.064827 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.065216 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.065375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.065535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.065712 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.066001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.066156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.066319 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.066611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.066785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.066944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.067102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.067253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.067403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.067577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.067754 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.067906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.068064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.068221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.068390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.068549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.068707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.068858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069322 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069481 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069631 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.069938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.070095 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.070244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.070419 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.070578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.070739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.070899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.071057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.071215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.071378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.071608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.071769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.071928 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.072079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.072236 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.072400 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.072770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.072928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.073403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.073561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.073727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.073727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.074021 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.074021 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.074352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.074539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.074703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.074854 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.075012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.075420 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.075600 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.075841 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.076288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.076518 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.076812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.076969 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.077121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.077271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.077441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.077601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.077760 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.077922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.078081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.078247 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.078398 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.078556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.078713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.078870 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.079029 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.079193 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.079399 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.079686 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.079930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.080174 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.080437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.080708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.080954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.081201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.081452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.081698 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.081959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.082207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.082463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.083000 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.083000 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.084036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.084292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.084513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.084746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.085003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.085252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.085252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.086072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.086527 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.086820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.087298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.087519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.087699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.087866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088498 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088660 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088813 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.088965 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.089115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.089265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.089415 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.089653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.089807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.089969 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.090120 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.090278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.090443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.090595 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.090753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.090913 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.091100 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.091328 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.091653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.091911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.092073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.092224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.092224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.092543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.092705 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.092864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.093236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.093403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.094086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.094346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.094346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.094839 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.095084 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.095342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.095676 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.096213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.096426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.096746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.096914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.097076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.097248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.097543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.097701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.097852 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098002 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098530 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.098996 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.099185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.099350 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.099586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.099745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.099895 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100833 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.100991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.101155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.101360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.101514 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.101664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.101822 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.101822 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.102114 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.102278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.102431 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.102604 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.102762 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.102919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.103078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.103448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.103639 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.103926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.104278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.104446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.104690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.104878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.105045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.105198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.105371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.105533 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.105694 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.105858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.106226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.106397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.107155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.107598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.108024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.108280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.108498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.108655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.108806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.108969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.109128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.109280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.109445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.109605 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.109774 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.109936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.110085 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.110243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.110410 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.110562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.110720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.110874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.111035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.111196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.111348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.111521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.111689 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.111849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112794 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.112963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.113656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.114793 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.114947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.115110 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.115261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.115535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.115723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.115884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.116036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.116405 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.116564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.116564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.116969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.117214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.117487 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.117912 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.119242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.119566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.119837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.120107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.120361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.120615 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.120891 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.121141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.121141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.121631 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.121881 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.122134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.123014 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.124823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.125116 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.125627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.125916 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.126173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.126768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.126945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.127105 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.127261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.127423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.127609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.127609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.128240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.128395 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.128556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.128720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.128720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.129046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.129339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.129339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.129645 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.129796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.129796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.130100 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.130254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.130254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.130547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.130699 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.130871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131314 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131511 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131679 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131846 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.131998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.132149 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.132307 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.132464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.132624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.132787 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.132938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.133096 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.133254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.133414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.133617 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.133795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.134157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.134387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.134664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.135043 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.135218 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.135381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.135600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.135755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.135931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.136091 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.136260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.136413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.136633 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.137003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.137164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.137330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.137484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.137645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.137807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.138121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.138522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.138792 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.139052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.139244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.139558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.139730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.139889 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.140050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.140216 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.140375 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.140526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.140692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.140853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141006 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141323 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.141949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.142111 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.142272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.142423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.142573 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.142748 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.142985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.143153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.143309 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.143487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.143664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.143817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.143984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.144336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.144496 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.144673 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.144954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.144954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.145475 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.145627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.145627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.145935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.146102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.146102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.146401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.146552 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.146552 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.147045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.147422 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.147609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.147796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.147796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.148086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.148251 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.148403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.148700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.148700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.149007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.149167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.149331 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.149496 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.149797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.149963 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.150135 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.150287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.150454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.150607 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.150758 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.150909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.151061 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.151211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.151414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.151604 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.151766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.151918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.152076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.152245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.152405 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.152564 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.152723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.152883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.153033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.153193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.153350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.153584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.153840 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.154039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.154586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.154839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.155146 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.156398 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.157489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.157659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.157815 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.157978 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.158141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.158295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.158446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.158446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.158914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.159076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.159259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.159412 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.159664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.159843 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.160131 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.160288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.160453 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.160605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.160763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.160763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.161077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.161077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.161402 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.161555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.161705 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.161863 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.162961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.163258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.163431 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.163620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.163773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.163773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.164067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.164220 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.164220 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.164524 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.164890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.165064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.165064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.165737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.165916 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.166077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.166228 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.166391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.166550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.166717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.166717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.167004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.167154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.178237 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.178237 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.179375 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.179574 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.179829 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.179986 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.180147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.180318 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.180506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.180740 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.180987 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.181212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.181455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.181624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.181794 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182672 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.182983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.184142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.186271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.187376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.188394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.189249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.190258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.191209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.192027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.193006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.194013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.195043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.196284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.197482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.198329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.199101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.200374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.201577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.202447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.203297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.204199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.205054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.206048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.207189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO dbcounter [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Registered counter for database nova_api Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.208582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.209777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.210354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.211184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212676 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.212970 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.213349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.213664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.214045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.214432 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.214754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.215147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.215502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.218746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.218746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.219153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.219327 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.219671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.219996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.220307 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.220620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.220930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.221236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.221545 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.221852 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.222157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.222464 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.222779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.223087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.223393 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.223729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.224039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.224344 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writer thread running {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.224511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.224700 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.225003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.225322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.225647 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.225964 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.226286 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.226601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.226943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.227343 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.227599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.227917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.228258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.228573 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.228884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.229195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.229512 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.229825 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.230189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.230566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.230896 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.231221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.232125 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.232409 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.232736 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.233059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.233469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.233863 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.234178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.234492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.234811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.235128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.235444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.235788 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.236165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.236506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.236904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.237323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.237717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.238048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.238366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.238704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.239917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.240326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.240711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.241220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.241539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.243017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.243017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.243017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:03:55.243017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:03:55.283565 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.context [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),edd000c1-ec71-4e3a-8f05-9866da848ed5(cell1) {{(pid=130762) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 15:03:55.287820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.289490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.290417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.292956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.295614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO dbcounter [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Registered counter for database nova_cell0 Jul 26 15:03:55.299729 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO dbcounter [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Registered counter for database nova_cell1 Jul 26 15:03:55.306996 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.308391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.308924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO dbcounter [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Registered counter for database nova_api Jul 26 15:03:55.314235 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writer thread running {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.317215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writer thread running {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.330564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.337557 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writer thread running {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.402454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.context [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),edd000c1-ec71-4e3a-8f05-9866da848ed5(cell1) {{(pid=130764) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 15:03:55.408151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.409869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.410757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.413265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.415427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO dbcounter [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Registered counter for database nova_cell0 Jul 26 15:03:55.420666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO dbcounter [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Registered counter for database nova_cell1 Jul 26 15:03:55.428356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.431338 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.439656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writer thread running {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.444112 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writer thread running {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.468894 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO dbcounter [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Registered counter for database nova_cell0 Jul 26 15:03:55.476491 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.483859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writer thread running {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.608677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO dbcounter [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Registered counter for database nova_cell0 Jul 26 15:03:55.615452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:03:55.620074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writer thread running {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:03:55.828501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: WARNING keystonemiddleware.auth_token [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:03:55.835958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: WARNING keystonemiddleware.auth_token [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:03:55.956591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: WARNING keystonemiddleware.auth_token [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:03:55.964093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: WARNING keystonemiddleware.auth_token [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:03:56.183187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: WARNING keystonemiddleware.auth_token [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:03:56.190749 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: WARNING keystonemiddleware.auth_token [None req-8c5fbf8b-5f1d-45aa-a993-0fb75683c66e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:03:56.196280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b4b51e59c0 pid: 130762 (default app) Jul 26 15:03:56.313945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: WARNING keystonemiddleware.auth_token [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:03:56.320140 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: WARNING keystonemiddleware.auth_token [None req-f4ccb5ed-569f-4482-a826-017ebd8c39d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:03:56.326340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b4b51e59c0 pid: 130764 (default app) Jul 26 15:04:42.919217 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:42.923115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:42.923115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:42.923115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:44.519731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6dda5d4d-ae21-490c-b69d-6b8db50921c5 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Action: 'create', calling method: .version_select at 0x7f4538a4d940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1173732195"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:47.154013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6dda5d4d-ae21-490c-b69d-6b8db50921c5 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.246676 Jul 26 15:04:47.155982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 1/1] 10.222.0.94 () {60 vars in 1155 bytes} [Tue Jul 26 15:04:42 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4251 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 15:04:47.541706 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e5892ceb-c0d2-4c6e-9b2f-3ed468032f69 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4538b004c0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:47.619622 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:47.622708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:47.624695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:47.626129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:48.208872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e5892ceb-c0d2-4c6e-9b2f-3ed468032f69 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 200 len: 345 microversion: 2.1 time: 1.039366 Jul 26 15:04:48.212425 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 1/2] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:04:47 2022] GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 345 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:49.228914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fcebaa0a-3127-4952-bc06-5fe7e9a709d8 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f453889f790>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:49.551087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fcebaa0a-3127-4952-bc06-5fe7e9a709d8 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 200 len: 346 microversion: 2.1 time: 0.327767 Jul 26 15:04:49.552265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 2/3] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:04:49 2022] GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 346 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:49.574066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-608c0972-ea39-4458-a595-cf8f04eb2afb tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Action: 'create', calling method: .version_select at 0x7f45389569d0>, body: {"snapshot": {"volume_id": "7f6864ac-6ed4-4b09-889a-1b32b419c8d9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1606785466"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:50.827928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-608c0972-ea39-4458-a595-cf8f04eb2afb tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.261644 Jul 26 15:04:50.829932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 2/4] 10.222.0.94 () {60 vars in 1162 bytes} [Tue Jul 26 15:04:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:50.844239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4b6426a7-5526-416b-a824-c19df11b4f8c tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f453889fe50>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:51.099581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4b6426a7-5526-416b-a824-c19df11b4f8c tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.256376 Jul 26 15:04:51.099581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 3/5] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:50 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:51.109666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f7287ee3-eabe-412f-bab3-c866d87a5e64 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4538956700>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:51.269588 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f7287ee3-eabe-412f-bab3-c866d87a5e64 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.163782 Jul 26 15:04:51.270802 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 3/6] 10.222.0.94 () {58 vars in 1140 bytes} [Tue Jul 26 15:04:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:04:51.294492 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e24fbd83-3478-489f-8830-987234d648eb tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f45388b25e0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:51.373444 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e24fbd83-3478-489f-8830-987234d648eb tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.086840 Jul 26 15:04:51.383342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 4/7] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:51 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:52.391175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9371c620-2b9b-402d-84ec-6927c4359b1b tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f45388b6a60>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:52.447948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9371c620-2b9b-402d-84ec-6927c4359b1b tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.060707 Jul 26 15:04:52.448924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 4/8] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:52 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:53.461192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-dd78b636-19ad-4867-9b2e-0211173fb6e8 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f453889fd30>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:53.567152 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-dd78b636-19ad-4867-9b2e-0211173fb6e8 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.110506 Jul 26 15:04:53.573777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 5/9] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:53 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:54.581046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-368cdb0f-1ba4-455e-997e-70d26aa0abd6 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f45388b91f0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:54.676504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-368cdb0f-1ba4-455e-997e-70d26aa0abd6 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.096393 Jul 26 15:04:54.676504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 5/10] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:54 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:55.690831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ba06fd23-d7fb-4b26-b138-4782b1e4f305 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f453889f670>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:55.766154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ba06fd23-d7fb-4b26-b138-4782b1e4f305 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.077685 Jul 26 15:04:55.769506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 6/11] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:55 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:56.779225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-30fea7be-dd84-4e49-b2fb-a546ecab7b00 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f45388b6940>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:56.866963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-30fea7be-dd84-4e49-b2fb-a546ecab7b00 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.094537 Jul 26 15:04:56.868392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 6/12] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:56 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:57.840753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1e0c0765-3d2d-4c24-b817-73cb06d18ed9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: .version_select at 0x7f45388b2310>, body: {"keypair": {"name": "tempest-keypair-54661891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjZVTK3cXFVW0ghGXSLr2kfmz+RSxUDszUYN3cB+gmoruTHlI5ynU1IPC7pAQd0oMViU1e7A+KISZqpOYZbV3vvIs/ynCf800bXgyWEYJbW74P5fLoRjrVnXYDpex/zeg=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:57.881298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2cddaed0-bf7c-4180-b005-62062f9df7a0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f45388b61f0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:57.938962 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2cddaed0-bf7c-4180-b005-62062f9df7a0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 288 microversion: 2.1 time: 0.061205 Jul 26 15:04:57.949904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-1e0c0765-3d2d-4c24-b817-73cb06d18ed9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:57.951899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 7/13] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:57 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:57.959046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f1322905-a2d1-4d02-8b34-d8ffa8509a21 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4538956ca0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:57.966682 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-1e0c0765-3d2d-4c24-b817-73cb06d18ed9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:58.151692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1e0c0765-3d2d-4c24-b817-73cb06d18ed9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.979490 Jul 26 15:04:58.153255 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 7/14] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:04:57 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:58.274865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f1322905-a2d1-4d02-8b34-d8ffa8509a21 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "DELETE /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 202 len: 0 microversion: 2.1 time: 0.321414 Jul 26 15:04:58.280784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 8/15] 10.222.0.94 () {58 vars in 1254 bytes} [Tue Jul 26 15:04:57 2022] DELETE /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:04:58.287487 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d4b33b28-002f-43c3-aa2a-007967d82bfe tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f453888fc10>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:58.406089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d4b33b28-002f-43c3-aa2a-007967d82bfe tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 200 len: 287 microversion: 2.1 time: 0.124171 Jul 26 15:04:58.407049 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 8/16] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:58 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:04:59.444064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b61ec8e9-815b-4849-a461-54b1c13288f7 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4539274c10>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:59.758854 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-b61ec8e9-815b-4849-a461-54b1c13288f7 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] HTTP exception thrown: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b61ec8e9-815b-4849-a461-54b1c13288f7 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Request method failure captured: Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 HTTP/1.1 Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKKCjkRSz-jfY9dsDJl-vSsaZ4yinup8DwBpfWVYlsuLliRC1zwN87Gx7tlM1WajdrqfCSDb-YE38C4YZVh6TUozdHQTPyi05tU2C7wKlmeHYm7Pbxia9LDE-eqRTp2KFuRUgE5od_TuA5BG-f60x3mjsEeXnuSbowkINf7vP6Pnzk Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:04:59.770531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: d342d63f84d64871a35fd5aad3a254fa Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '0c04de1e-3b98-4418-a9b0-9664f064cd11'} Jul 26 15:04:59.771734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. (HTTP 404) (Request-ID: req-a43dd94b-57b5-4821-8453-5821de6a3cfb) Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.772728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:04:59.773553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 15:04:59.774546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. Jul 26 15:04:59.775449 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:04:59.777539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b61ec8e9-815b-4849-a461-54b1c13288f7 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Returning 404 to user: Snapshot 0c04de1e-3b98-4418-a9b0-9664f064cd11 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:04:59.779129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b61ec8e9-815b-4849-a461-54b1c13288f7 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11" status: 404 len: 111 microversion: 2.1 time: 0.349697 Jul 26 15:04:59.785402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 9/17] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:04:59 2022] GET /compute/v2.1/os-snapshots/0c04de1e-3b98-4418-a9b0-9664f064cd11 => generated 111 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:04:59.809017 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cfdeafdf-10ad-416b-a99f-44faab035237 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4538045310>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:00.202418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cfdeafdf-10ad-416b-a99f-44faab035237 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 202 len: 0 microversion: 2.1 time: 0.410785 Jul 26 15:05:00.203411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 9/18] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:04:59 2022] DELETE /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:05:00.229402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7f99b52f-bdd1-4bd7-a166-8880792cc0e3 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4538b004c0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:00.608436 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7f99b52f-bdd1-4bd7-a166-8880792cc0e3 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 200 len: 345 microversion: 2.1 time: 0.398283 Jul 26 15:05:00.609717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 10/19] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:05:00 2022] GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 345 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:01.627723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c88551b9-3449-48ec-8e81-4bb6208daaa2 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4538045a60>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:01.726884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-c88551b9-3449-48ec-8e81-4bb6208daaa2 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] HTTP exception thrown: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c88551b9-3449-48ec-8e81-4bb6208daaa2 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Request method failure captured: Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 HTTP/1.1 Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKKCjkRSz-jfY9dsDJl-vSsaZ4yinup8DwBpfWVYlsuLliRC1zwN87Gx7tlM1WajdrqfCSDb-YE38C4YZVh6TUozdHQTPyi05tU2C7wKlmeHYm7Pbxia9LDE-eqRTp2KFuRUgE5od_TuA5BG-f60x3mjsEeXnuSbowkINf7vP6Pnzk Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:05:01.735780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d342d63f84d64871a35fd5aad3a254fa Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '7f6864ac-6ed4-4b09-889a-1b32b419c8d9'} Jul 26 15:05:01.737899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. (HTTP 404) (Request-ID: req-4eb780fc-7641-4d15-839e-aa040fd3654a) Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.739198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:05:01.742931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:05:01.750021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c88551b9-3449-48ec-8e81-4bb6208daaa2 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Returning 404 to user: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c88551b9-3449-48ec-8e81-4bb6208daaa2 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 404 len: 109 microversion: 2.1 time: 0.116831 Jul 26 15:05:01.752272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 10/20] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:05:01 2022] GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:05:01.755453 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c81beab6-a4f4-4b97-8c51-a28e57eaef20 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f45388b6ee0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:01.839951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-c81beab6-a4f4-4b97-8c51-a28e57eaef20 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] HTTP exception thrown: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c81beab6-a4f4-4b97-8c51-a28e57eaef20 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Request method failure captured: Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 HTTP/1.1 Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKKCjkRSz-jfY9dsDJl-vSsaZ4yinup8DwBpfWVYlsuLliRC1zwN87Gx7tlM1WajdrqfCSDb-YE38C4YZVh6TUozdHQTPyi05tU2C7wKlmeHYm7Pbxia9LDE-eqRTp2KFuRUgE5od_TuA5BG-f60x3mjsEeXnuSbowkINf7vP6Pnzk Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:05:01.841522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: d342d63f84d64871a35fd5aad3a254fa Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '7f6864ac-6ed4-4b09-889a-1b32b419c8d9'} Jul 26 15:05:01.844259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. (HTTP 404) (Request-ID: req-9d89dd24-874b-479a-bab0-ab5229a664b8) Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.845804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:05:01.849339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:05:01.851542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c81beab6-a4f4-4b97-8c51-a28e57eaef20 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Returning 404 to user: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:05:01.853652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c81beab6-a4f4-4b97-8c51-a28e57eaef20 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 404 len: 109 microversion: 2.1 time: 0.091669 Jul 26 15:05:01.857515 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8e76d8c0-770b-4d05-980d-0311396876d0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Calling method '.version_select at 0x7f4533f98160>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:01.859066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 11/21] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:05:01 2022] DELETE /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:05:01.970720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-8e76d8c0-770b-4d05-980d-0311396876d0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] HTTP exception thrown: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8e76d8c0-770b-4d05-980d-0311396876d0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Request method failure captured: Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 HTTP/1.1 Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKKCjkRSz-jfY9dsDJl-vSsaZ4yinup8DwBpfWVYlsuLliRC1zwN87Gx7tlM1WajdrqfCSDb-YE38C4YZVh6TUozdHQTPyi05tU2C7wKlmeHYm7Pbxia9LDE-eqRTp2KFuRUgE5od_TuA5BG-f60x3mjsEeXnuSbowkINf7vP6Pnzk Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:05:01.980230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2698a98c09a94ac0a09c50a6961fc431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 2698a98c09a94ac0a09c50a6961fc431 Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343100478 Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d342d63f84d64871a35fd5aad3a254fa Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343100478-project Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '7f6864ac-6ed4-4b09-889a-1b32b419c8d9'} Jul 26 15:05:01.984077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. (HTTP 404) (Request-ID: req-74ff401e-4233-474e-a28e-b78a3b22e41d) Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.985357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:05:01.986814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:05:01.988369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8e76d8c0-770b-4d05-980d-0311396876d0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] Returning 404 to user: Volume 7f6864ac-6ed4-4b09-889a-1b32b419c8d9 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:05:01.989743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8e76d8c0-770b-4d05-980d-0311396876d0 tempest-VolumesSnapshotsTestJSON-343100478 tempest-VolumesSnapshotsTestJSON-343100478-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9" status: 404 len: 109 microversion: 2.1 time: 0.134224 Jul 26 15:05:01.991535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 11/22] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:05:01 2022] GET /compute/v2.1/os-volumes/7f6864ac-6ed4-4b09-889a-1b32b419c8d9 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:05:05.270693 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1278918707", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "networks": [{"uuid": "a3150bab-ca1f-4ff6-8e48-2587db7cfe8e"}]}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:05.303488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f9a10bc9-37ef-4265-833b-78bf7adf4934 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: .version_select at 0x7f4533f98430>, body: {"keypair": {"name": "tempest-keypair-933417146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH137TXyx7Uw0EqadKAPTmfsPQShsMYNKEET8B/gnSzg7dgQhvt3KjHRhWtUMMYbqmIY0o1ZJALbxBnT40w1JydYCqHfWbuy4NdVndMNmbVHNsUZyDfbOBOszcA9skRVxA=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:05.348241 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-f9a10bc9-37ef-4265-833b-78bf7adf4934 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for project 08db5f6552054a6c97ed644366d18b22. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:05.366477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-f9a10bc9-37ef-4265-833b-78bf7adf4934 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for user a1bc5bf55e9d452b88757ea4080165e0 and project 08db5f6552054a6c97ed644366d18b22. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:05.481540 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] validate_networks() for [('a3150bab-ca1f-4ff6-8e48-2587db7cfe8e', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:05:05.574748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f9a10bc9-37ef-4265-833b-78bf7adf4934 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.476789 Jul 26 15:05:05.576075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 12/23] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:05:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:05:05.747977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-133780792", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd3e2f67-4b42-4920-a974-5409190c3fa7"}], "security_groups": [{"name": "tempest-securitygroup--1855048365"}], "key_name": "tempest-keypair-54661891", "user_data": "}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:06.938799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] validate_networks() for [('bd3e2f67-4b42-4920-a974-5409190c3fa7', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:05:08.549849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:08.551520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:08.552324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:08.552914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:08.553471 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:08.625832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:08.626268 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:08.636463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:08.637217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:08.791507 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Getting quotas for project bb18a5955f814887bcfa9650bcaa2ce9. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:08.811961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Getting quotas for user c15d08b7eb014af3afc4d0a6e032f740 and project bb18a5955f814887bcfa9650bcaa2ce9. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:08.863987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:05:08.868833 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:05:09.227498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ee3a9498-b4bb-4776-bebb-f45c8ed83d8b tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.361176 Jul 26 15:05:09.229096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 12/24] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:05:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 4363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:05:09.713373 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2113932647", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:09.839560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] validate_networks() for [('a8d3dae5-c67b-4195-9daa-754dae1d5468', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:05:09.848600 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:09.849275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:09.849911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:09.850465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:09.850946 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:09.866953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:09.867907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:09.868943 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:09.871223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:09.943269 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:09.965837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:09.987033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:05:09.998259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:05:10.215544 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e8359e3d-a414-4607-9667-907881da7e78 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.492677 Jul 26 15:05:10.217191 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 13/25] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:05:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 4496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 15:05:10.263860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f6b4d7ed-4e5b-4e93-b747-8650f2964aa3 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:10.263860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f6b4d7ed-4e5b-4e93-b747-8650f2964aa3 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:10.633185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f6b4d7ed-4e5b-4e93-b747-8650f2964aa3 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:10.677154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f6b4d7ed-4e5b-4e93-b747-8650f2964aa3 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1215 microversion: 2.1 time: 0.454683 Jul 26 15:05:10.679253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 14/26] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:10 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1215 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:10.699441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-01010ec6-a251-4785-bb58-b73e181092db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:10.700557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-01010ec6-a251-4785-bb58-b73e181092db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:10.851798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-01010ec6-a251-4785-bb58-b73e181092db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:10.868734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-01010ec6-a251-4785-bb58-b73e181092db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1239 microversion: 2.1 time: 0.184516 Jul 26 15:05:10.870016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 15/27] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:10 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:11.716925 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e701c600-eb16-4a00-8a24-f7ef3f5b12db tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:11.718283 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e701c600-eb16-4a00-8a24-f7ef3f5b12db tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:11.861648 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e701c600-eb16-4a00-8a24-f7ef3f5b12db tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:11.872953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e701c600-eb16-4a00-8a24-f7ef3f5b12db tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1215 microversion: 2.1 time: 0.161225 Jul 26 15:05:11.874454 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 16/28] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:11 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:11.952215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3ebecb80-e35d-4bd2-91b3-e6e06af707de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:11.958791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3ebecb80-e35d-4bd2-91b3-e6e06af707de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:12.160897 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3ebecb80-e35d-4bd2-91b3-e6e06af707de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:12.185444 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3ebecb80-e35d-4bd2-91b3-e6e06af707de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1239 microversion: 2.1 time: 0.259605 Jul 26 15:05:12.214765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 17/29] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:11 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1239 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:12.356560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:12.357086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:12.357447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:12.357853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:12.358529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:12.378032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:12.378486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:12.382865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:12.384103 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:12.439225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for project dbe01616efc64d2e901f45662e7c3518. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:12.474900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for user 61b3efca1989483d960b9f92d655d39e and project dbe01616efc64d2e901f45662e7c3518. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:12.541754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:05:12.552190 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:05:12.876926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-093a59ba-0240-468f-a152-26f0290be82a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.646276 Jul 26 15:05:12.885483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 13/30] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:05:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:05:12.902103 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4700d986-1ad5-46d5-8389-07136373c432 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:12.903130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-36c7ff51-548d-405e-ad30-9c89892f3c6f tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:12.908970 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-36c7ff51-548d-405e-ad30-9c89892f3c6f tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:12.909299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4700d986-1ad5-46d5-8389-07136373c432 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:13.179645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-36c7ff51-548d-405e-ad30-9c89892f3c6f tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:13.192535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-36c7ff51-548d-405e-ad30-9c89892f3c6f tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1215 microversion: 2.1 time: 0.300751 Jul 26 15:05:13.207503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 18/31] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:12 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1215 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:13.213437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ff740922-2e68-4211-916d-8a034e83a4c2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:13.213437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ff740922-2e68-4211-916d-8a034e83a4c2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:13.405829 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ff740922-2e68-4211-916d-8a034e83a4c2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:13.413807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ff740922-2e68-4211-916d-8a034e83a4c2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1239 microversion: 2.1 time: 0.207985 Jul 26 15:05:13.417965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 19/32] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:13 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1239 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:13.534983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4700d986-1ad5-46d5-8389-07136373c432 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:13.595224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4700d986-1ad5-46d5-8389-07136373c432 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1222 microversion: 2.1 time: 0.693376 Jul 26 15:05:13.598341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 14/33] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:12 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1222 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:13.924359 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1887784191", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:14.068654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] validate_networks() for [('a8d3dae5-c67b-4195-9daa-754dae1d5468', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:05:14.234633 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:14.239706 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:14.281009 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.287016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.290122 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.292340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.558601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:14.614151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2ca95272-3ac0-4f93-ae1d-341e24cdd4e0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1219 microversion: 2.1 time: 0.385640 Jul 26 15:05:14.620344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 15/34] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:14 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1219 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:14.631927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:14.634044 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:14.662529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.662980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.663844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.664280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.821709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:14.861729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-70f5472c-ef5e-41f1-934f-a78d31d332ea tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1243 microversion: 2.1 time: 0.238915 Jul 26 15:05:14.866002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 16/35] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:14 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1243 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:14.960077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2003610584", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25e10047-eaa5-41ef-808b-1d7621a68610"}], "security_groups": [{"name": "tempest-securitygroup--1093713109"}], "key_name": "tempest-keypair-933417146", "user_data": "}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:15.449752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] validate_networks() for [('25e10047-eaa5-41ef-808b-1d7621a68610', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:05:15.495971 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:15.496680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:15.497285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:15.497828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:15.498381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:15.523351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:15.524086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:15.525158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:15.526364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:15.549716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for project dbe01616efc64d2e901f45662e7c3518. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:15.555114 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for user 61b3efca1989483d960b9f92d655d39e and project dbe01616efc64d2e901f45662e7c3518. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:15.574345 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:05:15.578408 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:05:15.841521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-69ddfddb-9fcc-4564-b15d-aec74e41ee9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.926453 Jul 26 15:05:15.847176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 20/36] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:05:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:05:15.869899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:15.870722 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:15.907932 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:15.908488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:15.909921 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:15.910445 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.231791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.250300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5f12ae0b-18a7-445b-b88e-ceb7c03222af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1267 microversion: 2.1 time: 0.398263 Jul 26 15:05:16.251145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 21/37] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:15 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:16.257446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-18ab7893-66f3-4748-ad6e-ce6f0dcba950 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:16.258485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-18ab7893-66f3-4748-ad6e-ce6f0dcba950 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:16.374518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-18ab7893-66f3-4748-ad6e-ce6f0dcba950 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.384500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-18ab7893-66f3-4748-ad6e-ce6f0dcba950 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1222 microversion: 2.1 time: 0.131963 Jul 26 15:05:16.385114 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 22/38] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:16 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:16.406495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:16.407400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:16.434936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.436606 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.440913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.445088 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.512147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:16.513504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:16.514202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:16.516316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:16.517087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:16.559420 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.564919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.577611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.581563 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.654601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for project 08db5f6552054a6c97ed644366d18b22. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:16.655922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.662943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for user a1bc5bf55e9d452b88757ea4080165e0 and project 08db5f6552054a6c97ed644366d18b22. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:16.673266 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-52b079c5-caf0-4064-ae68-c94745e3443d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1291 microversion: 2.1 time: 0.272717 Jul 26 15:05:16.687495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 23/39] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:16 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1291 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:16.698866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:05:16.703175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:05:16.957135 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-badd8706-dc24-425a-a547-6b00122292e2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.000769 Jul 26 15:05:16.961550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 17/40] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:05:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:05:16.975956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-172b2474-0735-4381-8cb9-7fad69726841 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:16.977630 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-172b2474-0735-4381-8cb9-7fad69726841 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:17.280760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:17.282591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:17.293867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:17.294768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:17.300366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:17.300366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:17.422123 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-172b2474-0735-4381-8cb9-7fad69726841 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:17.446683 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-172b2474-0735-4381-8cb9-7fad69726841 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1237 microversion: 2.1 time: 0.474549 Jul 26 15:05:17.465770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 24/41] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:16 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1237 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:17.465770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cd8effff-6785-458e-9623-be5d715fa0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:17.466317 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cd8effff-6785-458e-9623-be5d715fa0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:17.577674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:17.607140 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d98afca8-9fd5-4ac4-a42d-2b5669d91eb9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1275 microversion: 2.1 time: 0.334654 Jul 26 15:05:17.630394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 18/42] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:17 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1275 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:17.704006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:17.704972 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:17.716337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:17.717385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:17.718739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:17.719886 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:17.910181 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cd8effff-6785-458e-9623-be5d715fa0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:17.928312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cd8effff-6785-458e-9623-be5d715fa0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1222 microversion: 2.1 time: 0.474645 Jul 26 15:05:17.930209 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 25/43] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:17 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1222 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:18.309468 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:18.317675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2fbb2489-0f9d-4016-b930-153d6b817692 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1297 microversion: 2.1 time: 0.618923 Jul 26 15:05:18.321554 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 19/44] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:17 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1297 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:18.490639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ac806367-228e-401b-a402-7bbf95edcaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:18.492314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ac806367-228e-401b-a402-7bbf95edcaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:18.500260 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:18.623137 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ac806367-228e-401b-a402-7bbf95edcaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:18.644193 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:18.644877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:18.646124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ac806367-228e-401b-a402-7bbf95edcaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1237 microversion: 2.1 time: 0.151706 Jul 26 15:05:18.647041 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 26/45] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:18 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1237 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:18.658206 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.658846 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:18.659765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.664313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:18.889559 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:18.927659 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e7c24d31-07c7-484b-a464-b0ef83ad60b7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1273 microversion: 2.1 time: 0.265460 Jul 26 15:05:18.945171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 20/46] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:18 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:18.973367 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:18.975181 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:18.993233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.997640 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:18.997640 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.997640 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:19.194727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:19.223236 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5a8560b5-da5f-456d-921f-ae231091abaa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1218 microversion: 2.1 time: 0.243325 Jul 26 15:05:19.226556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 27/47] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:18 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1218 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:19.355433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:19.357002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:19.412110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:19.413662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:19.414829 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:19.416907 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:19.673606 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:19.674469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:19.725880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:19.726688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:19.747379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:19.747700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:20.017413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:20.042479 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:20.044587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2edcb418-be44-4c41-bb1d-d4568cdc2da1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1241 microversion: 2.1 time: 0.375570 Jul 26 15:05:20.050883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 28/48] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:19 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1241 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:20.050883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:20.061340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:20.076936 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e1b66ecf-0a0a-43b5-8e31-f77fff676c6b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1297 microversion: 2.1 time: 0.727403 Jul 26 15:05:20.082169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:20.090643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:20.091027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 21/49] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:19 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1297 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:20.095504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:20.102625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:20.232746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:20.245126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c0a7c006-93a1-4d88-84b3-3065378f0fc1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1273 microversion: 2.1 time: 0.198354 Jul 26 15:05:20.246421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 29/50] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:20 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:20.266469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:20.273426 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:20.286118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:20.292818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:20.294483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:20.295237 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.018605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:21.034305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4b301472-fa46-4762-b6c8-7d3829cbd982 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1274 microversion: 2.1 time: 0.786043 Jul 26 15:05:21.034940 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 22/51] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:20 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1274 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:21.089546 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:21.090780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:21.114684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:21.116183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.117285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:21.118208 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.132755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:21.133472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:21.145958 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:21.148581 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.150371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:21.151263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.515651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:21.531325 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b0b8f78f-be09-46b3-b7cc-0029b81eef8f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1289 microversion: 2.1 time: 0.445393 Jul 26 15:05:21.547882 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 30/52] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:21 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1289 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:21.561232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:21.565929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:21.598988 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:21.602767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.605287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:21.608165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:21.978777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:21.995121 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-74fb8a57-b2e0-4e28-b9af-a3e6ecb7eee7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.863389 Jul 26 15:05:21.998709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 23/53] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:21 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:22.080844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:22.089351 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:22.113910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.114364 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:22.131874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.131874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:22.158013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:22.191816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-18dfc0c9-af39-439f-8eb5-4b9a7851e9ee tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.638100 Jul 26 15:05:22.191816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 31/54] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:21 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:22.466789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:22.481726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a95c92be-0391-4c2a-a537-2ca93f8cfd72 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1280 microversion: 2.1 time: 0.418924 Jul 26 15:05:22.482675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 24/55] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:22 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1280 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:22.556748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:22.557013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:22.577998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.578653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:22.589428 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.589428 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.039787 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.042655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.053638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:23.068567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3d8989a1-59d7-4d28-bc64-a0fd35552a4f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1307 microversion: 2.1 time: 0.516040 Jul 26 15:05:23.069764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 32/56] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:22 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:23.070898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.071352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.084115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.088150 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.223717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.224558 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.249197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.252499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.257723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.267238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.917278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:23.934096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f0239a63-c191-4ab8-8f77-0ceb7d1b0320 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.900717 Jul 26 15:05:23.948690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 25/57] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:23.955335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.968748 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.976002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.976778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.977877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.978931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.180708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.219024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-68fe6175-3070-43d2-8014-3569c1931822 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1280 microversion: 2.1 time: 0.268920 Jul 26 15:05:24.224652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 26/58] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:24.250636 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:24.265513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:24.304541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.314239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.314239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.314239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.613264 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.628789 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ac82ccec-7c19-4b8a-8113-9d64df7be7ec tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 1.411577 Jul 26 15:05:24.634489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 33/59] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:24.669169 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.680416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-66835811-8c2e-41fe-9047-4e1485d8528c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1295 microversion: 2.1 time: 0.459678 Jul 26 15:05:24.685459 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 27/60] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:24 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1295 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:24.968005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:24.968884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:24.992795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.994070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.995093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.006241 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.284249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:25.298811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:25.299150 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.304319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.305515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.306852 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.535364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=4 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:25.627379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:25.642413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-609e73c6-7d95-4f36-9b00-62331d215bad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.687016 Jul 26 15:05:25.645324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 34/61] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:24 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:25.657829 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:25.658996 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:25.667039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.667846 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.668982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.669649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.250118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:26.280727 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-16520bb9-9e7c-4ef3-89ec-f018a8385658 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1280 microversion: 2.1 time: 0.999987 Jul 26 15:05:26.283923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 28/62] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:25 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1280 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:26.328325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:26.334007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:26.374301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.377778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.410402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.411296 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.493965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:26.526093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-534dbcb0-fc40-42ac-aac5-84f344b2a926 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.869901 Jul 26 15:05:26.530731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 35/63] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:25 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:26.624530 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=6 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:26.675009 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=20 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:26.885885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-7363647d-724e-440b-b337-e1e0509f5904 req-716a855f-f63c-404e-8a78-5c6ba2eb54ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe50a6b-2228-43d7-be82-df26fcab6088", "tag": "498672af-1542-4fdd-8bf4-5a5c5cabe7ca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:26.911885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-7363647d-724e-440b-b337-e1e0509f5904 req-716a855f-f63c-404e-8a78-5c6ba2eb54ac service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.912439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-7363647d-724e-440b-b337-e1e0509f5904 req-716a855f-f63c-404e-8a78-5c6ba2eb54ac service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.935758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-7363647d-724e-440b-b337-e1e0509f5904 req-716a855f-f63c-404e-8a78-5c6ba2eb54ac service nova] Creating event network-changed:498672af-1542-4fdd-8bf4-5a5c5cabe7ca for instance 7fe50a6b-2228-43d7-be82-df26fcab6088 on hv-cinder-85066 Jul 26 15:05:26.936344 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-7363647d-724e-440b-b337-e1e0509f5904 req-716a855f-f63c-404e-8a78-5c6ba2eb54ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=130762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 15:05:26.937681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.939456 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.939904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.940370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.952377 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.compute.rpcapi [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 15:05:26.953636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] Releasing lock "compute-rpcapi-router" {{(pid=130762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 15:05:26.989073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-16eecf8e-b415-4745-84e5-4bb7d1206b4b None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319581 Jul 26 15:05:26.990655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 36/64] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:27.012682 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:27.013737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:27.031650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.033379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.034425 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.035849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.093017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:27.129760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8868c2bf-011d-4da7-8705-75bd2c311275 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.843817 Jul 26 15:05:27.136092 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 29/65] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:26 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:27.324807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:27.326478 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:27.327094 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:27.339960 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.340546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.341234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.341667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.342083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6bcb706d-bb86-4d3d-a46b-8a7c7a09842b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.349666 Jul 26 15:05:27.359677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 37/66] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:26 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:27.582988 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:27.584766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:27.605500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.607538 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.609299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.610473 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.850589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:27.880144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-dae8e981-2dc2-43b2-9924-e67ac0428b90 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.559837 Jul 26 15:05:27.896647 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 30/67] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:27 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:27.938051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:27.947834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-29ac2b83-66ef-4b7b-9caf-3a85937c11cc tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.382581 Jul 26 15:05:27.953503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 38/68] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:27 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:28.166105 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:28.166943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:28.178609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:28.179063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.179941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:28.180437 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.271570 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:28.386016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:28.390116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:28.433904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:28.435609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.437415 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:28.438410 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.630075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=40 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:28.663278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:28.673191 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-95ef2657-63b5-4a5c-a4f4-5d36d28cbb02 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.295813 Jul 26 15:05:28.673810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 39/69] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:28 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:28.770370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:28.784553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-36294fc7-f332-46c8-bb9d-f27b280d90fa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.623577 Jul 26 15:05:28.796391 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 31/70] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:28 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:28.911952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:28.913362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:28.925235 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:28.926117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.927633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:28.928825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.979437 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:28.987994 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:29.014310 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.017804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.017804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.017804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.280837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:29.290717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e65237ee-66c9-431a-99a4-940c2c74d115 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.387420 Jul 26 15:05:29.291298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 40/71] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:28 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:29.296130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-0ff86372-3c9b-4c33-adf0-d019b3be41c5 req-45cb3e25-1a84-42fb-a1aa-9c936918116f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e94e2c3-8b57-4a91-831d-7afb4e64dcaf", "tag": "957f7279-c7e0-4980-871c-ba5e2033c52a"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:29.315873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-0ff86372-3c9b-4c33-adf0-d019b3be41c5 req-45cb3e25-1a84-42fb-a1aa-9c936918116f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.318370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-0ff86372-3c9b-4c33-adf0-d019b3be41c5 req-45cb3e25-1a84-42fb-a1aa-9c936918116f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.327979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:29.337939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-0ff86372-3c9b-4c33-adf0-d019b3be41c5 req-45cb3e25-1a84-42fb-a1aa-9c936918116f service nova] Creating event network-changed:957f7279-c7e0-4980-871c-ba5e2033c52a for instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf on hv-cinder-85066 Jul 26 15:05:29.344194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-0ff86372-3c9b-4c33-adf0-d019b3be41c5 req-45cb3e25-1a84-42fb-a1aa-9c936918116f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051543 Jul 26 15:05:29.345010 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 41/72] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:29.391830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:29.404812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-066da979-6852-421a-95cd-d1453692022a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.434172 Jul 26 15:05:29.407057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 32/73] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:28 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:29.449232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-6380adca-c3c4-49c6-8aea-b16b48efcd74 req-78b56d7e-0c04-4815-aafc-b2f66280529b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebca4e54-4a78-49e4-b381-6cd1203b3535", "tag": "0552bdab-a714-4a7a-a202-96df45a02287"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:29.464839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-6380adca-c3c4-49c6-8aea-b16b48efcd74 req-78b56d7e-0c04-4815-aafc-b2f66280529b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.473202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-6380adca-c3c4-49c6-8aea-b16b48efcd74 req-78b56d7e-0c04-4815-aafc-b2f66280529b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.478090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-6380adca-c3c4-49c6-8aea-b16b48efcd74 req-78b56d7e-0c04-4815-aafc-b2f66280529b service nova] Creating event network-changed:0552bdab-a714-4a7a-a202-96df45a02287 for instance ebca4e54-4a78-49e4-b381-6cd1203b3535 on hv-cinder-85066 Jul 26 15:05:29.484067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-6380adca-c3c4-49c6-8aea-b16b48efcd74 req-78b56d7e-0c04-4815-aafc-b2f66280529b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137218 Jul 26 15:05:29.484721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 42/74] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:29.697998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:29.698642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:29.700709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:29.715761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.715761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.715761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.715761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.820561 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:29.821257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:29.828797 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.829245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.830067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.831102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.856628 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:29.864863 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-97ba3ab1-6c5b-4c3d-8a71-f5105826f15e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.172487 Jul 26 15:05:29.865985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 33/75] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:29 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:29.983612 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:29.997647 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d4bbd2b4-a495-4383-bce6-2ff8c922894d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.182300 Jul 26 15:05:29.998926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 43/76] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:29 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:30.312240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:30.312872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:30.322592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.323502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.324973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.325837 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.430358 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:30.431305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:30.438990 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.439690 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.440710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.441251 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.519876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:30.534338 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2841e597-dcb9-4799-bc51-1a75cd43e204 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.226501 Jul 26 15:05:30.550946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 34/77] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:30 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:30.689956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:30.700004 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-087c6e9e-2bbc-4161-b40c-e711c5b23d03 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.273843 Jul 26 15:05:30.701328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 44/78] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:30 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:30.889187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:30.890517 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:30.898007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.898495 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.899331 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.901439 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.030791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:31.031333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:31.042259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.042713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.043685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.044121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.116722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:31.134888 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b53d115f-7755-4fed-9379-1a00e2ebc965 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.248111 Jul 26 15:05:31.171817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 35/79] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:30 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:31.311689 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:31.327832 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-68c3422f-8120-4a14-ba5c-7204f5028f53 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.300664 Jul 26 15:05:31.328944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 45/80] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:31 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:31.563677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:31.564550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:31.581935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.582645 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.583728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.584785 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.738958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:31.741784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:31.765060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.766278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.768174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.770189 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.909415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:31.923801 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5f047ddd-845a-45b2-87bf-1df94d328532 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.368874 Jul 26 15:05:31.926823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 36/81] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:31 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:32.113706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:32.152325 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6fad99db-6765-4171-b02d-ad0f8fed37f9 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.418819 Jul 26 15:05:32.174544 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 46/82] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:31 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:32.190188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:32.195031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:32.206695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:32.208457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:32.211083 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:32.212798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:32.354920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:32.356731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:32.383383 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:32.389465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:32.394428 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:32.395235 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:33.246359 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:33.279630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c9fba546-a9da-4926-a8d8-af6173442434 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 1.097561 Jul 26 15:05:33.280809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 37/83] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:32 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:33.289485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:33.291321 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:33.311129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:33.311710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:33.312948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:33.315043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:33.499509 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:33.514965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-34ff61b7-8138-4f3d-85a0-62efeef2b3dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 1.167683 Jul 26 15:05:33.516730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 47/84] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:32 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:33.523748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:33.525578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:33.560614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:33.561070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:33.570203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:33.570203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:33.833135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:33.848319 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ecc90b8f-80c0-4d8e-ba34-339bc1ee4329 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.329290 Jul 26 15:05:33.849447 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 48/85] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:33 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:33.967456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:33.984694 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e322ee0e-8f03-4318-91e8-cd7bdc26e5b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.702319 Jul 26 15:05:33.985836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 38/86] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:33 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:34.313632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:34.314244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:34.320699 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:34.321147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:34.322745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:34.323230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:34.559748 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:34.560782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:34.569513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:34.575260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:34.575619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:34.578081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:34.586638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:34.589508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2748ffb9-745d-4fad-8a24-0cfb79b8648c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.279045 Jul 26 15:05:34.590655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 49/87] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:34 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:34.888812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:34.897325 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:34.912382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:34.913295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:34.921271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:34.922225 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.050927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:35.064750 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-beb7a29a-07b9-46e7-9c9e-a5638b936c8e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.514167 Jul 26 15:05:35.070627 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 39/88] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:34 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:35.082729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:35.083753 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:35.094571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.095680 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.097335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.098366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.191194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:35.200632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d85911de-a8d6-41b2-9cdc-ca47462fc7a8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.333467 Jul 26 15:05:35.201238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 50/89] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:34 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:35.283863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-25aa36bc-9de3-4810-a4c9-46729b532f1e req-ca491cb6-03fe-4c7d-a7e2-e58eb1406ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d42296f-f3c6-4b95-999e-7b15b6537bfd", "tag": "e9809239-4b3d-4ebd-a706-267b3a41b7eb"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:35.297930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-25aa36bc-9de3-4810-a4c9-46729b532f1e req-ca491cb6-03fe-4c7d-a7e2-e58eb1406ca9 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.298437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-25aa36bc-9de3-4810-a4c9-46729b532f1e req-ca491cb6-03fe-4c7d-a7e2-e58eb1406ca9 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.312565 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-25aa36bc-9de3-4810-a4c9-46729b532f1e req-ca491cb6-03fe-4c7d-a7e2-e58eb1406ca9 service nova] Creating event network-changed:e9809239-4b3d-4ebd-a706-267b3a41b7eb for instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd on hv-cinder-85066 Jul 26 15:05:35.322086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-25aa36bc-9de3-4810-a4c9-46729b532f1e req-ca491cb6-03fe-4c7d-a7e2-e58eb1406ca9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047043 Jul 26 15:05:35.323511 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 51/90] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:35.462606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:35.477246 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-81cdea48-4e5e-4049-8a73-fa4af45aaf27 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.399407 Jul 26 15:05:35.479269 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 40/91] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:35 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:35.632689 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:35.634899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:35.647265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.647781 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.649441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.651565 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.842795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:35.852437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a6623934-d4a1-41be-a7ee-bdcc22b02223 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.229023 Jul 26 15:05:35.853311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 52/92] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:35 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:36.115489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:36.118999 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:36.131780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.133220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.135971 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.137723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.222138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:36.222964 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:36.234460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.235174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.236176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.241479 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.441805 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:36.459183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-895e6224-801c-413e-b7fa-0ddc184351f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.354561 Jul 26 15:05:36.464993 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 41/93] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:36 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:36.505893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:36.507379 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:36.518970 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.519420 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.523823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.524953 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.734508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:36.791010 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-07d09674-ff45-4dc4-8eff-8b440e8e3372 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.571831 Jul 26 15:05:36.799769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 53/94] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:36 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:36.883287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:36.886061 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:36.923799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.924590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.925983 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.926739 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.951427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:37.646165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:37.674246 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0f6a99cf-1553-4e38-9f2e-4d84aad3327c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 1.170024 Jul 26 15:05:37.678705 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 42/95] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:36 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:37.701010 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-8e5cd262-3cb3-453e-8b1a-39bfb3ae3bc5 req-aad5e590-bd84-44e6-970c-aa55342dea1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06447f6-a112-4dc5-96aa-87f3189a038e", "tag": "18c5b7fd-eaad-4eca-8964-f04ead1ce7f7"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:37.735411 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-8e5cd262-3cb3-453e-8b1a-39bfb3ae3bc5 req-aad5e590-bd84-44e6-970c-aa55342dea1d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.735938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-8e5cd262-3cb3-453e-8b1a-39bfb3ae3bc5 req-aad5e590-bd84-44e6-970c-aa55342dea1d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:37.769633 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-8e5cd262-3cb3-453e-8b1a-39bfb3ae3bc5 req-aad5e590-bd84-44e6-970c-aa55342dea1d service nova] Creating event network-changed:18c5b7fd-eaad-4eca-8964-f04ead1ce7f7 for instance c06447f6-a112-4dc5-96aa-87f3189a038e on hv-cinder-85066 Jul 26 15:05:37.770259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-8e5cd262-3cb3-453e-8b1a-39bfb3ae3bc5 req-aad5e590-bd84-44e6-970c-aa55342dea1d service nova] Acquired lock "compute-rpcapi-router" {{(pid=130764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 15:05:37.771548 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.772036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:37.772865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.773300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:37.831836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.compute.rpcapi [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 15:05:37.833034 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] Releasing lock "compute-rpcapi-router" {{(pid=130764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 15:05:37.888724 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-bd2cafca-8ffd-490f-8792-af71e33cdfc3 None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207048 Jul 26 15:05:37.890000 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 43/96] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:37.900273 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:37.901401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:37.917099 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.919074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:37.921065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.922814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:38.003719 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:38.036947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-23832dd5-92e7-4a5e-8f99-d32ba17763a7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 1.163629 Jul 26 15:05:38.050267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 54/97] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:36 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:38.063998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:38.065119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:38.072926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:38.077137 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:38.082014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:38.082665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:38.560091 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:38.577215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9aaaf98a-0064-404c-b3da-39878c012dbf tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.525130 Jul 26 15:05:38.579033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 55/98] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:38 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:38.700155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:38.700943 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:38.713362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:38.713362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:38.713362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:38.713362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.028426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:39.040828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c7475f73-c872-481d-9199-243bf7737062 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.345755 Jul 26 15:05:39.050132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 56/99] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:38 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:39.070775 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:39.071661 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:39.103508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.103508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.103508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.104730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.149077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:39.162717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-80f10020-2d40-4b06-9932-eb090a30c95d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 1.271141 Jul 26 15:05:39.163873 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 44/100] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:37 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:39.453409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:39.462395 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-463fd330-9751-4c29-a83c-b4311d6ec2c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.395211 Jul 26 15:05:39.463731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 57/101] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:39 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:39.602974 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:39.603856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:39.610243 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.610778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.611673 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.612174 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.792106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:39.800509 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7b3ea87f-7126-419f-8ee9-bd9c263d23ba tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.201471 Jul 26 15:05:39.801293 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 45/102] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:39 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:40.066976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:40.068206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:40.076103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.076558 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.077372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.077807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.195209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:40.196225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:40.204299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.205058 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.206570 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.207127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.257637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:40.267203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-358c0d09-45e6-40d2-9bc3-a1ddc6ad7782 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.205313 Jul 26 15:05:40.273918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 58/103] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:40 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:40.375397 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:40.387026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a1ae0dbd-ecc1-4ca9-a0f6-b78917890ba0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.198264 Jul 26 15:05:40.387649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 46/104] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:40 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:40.485134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:40.485768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:40.495875 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.496462 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.497717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.498592 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.709307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:40.713765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:40.718773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-406b6427-fd88-4e3e-b71b-ffc563426d08 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.237744 Jul 26 15:05:40.719374 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 59/105] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:40 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:40.830182 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:40.830799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:40.838328 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.840265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.840265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:40.840265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.019728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:41.035259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d2b0319a-ceb6-4af4-8b69-4697de2a46c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.209261 Jul 26 15:05:41.036370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 47/106] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:40 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:41.288186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:41.289144 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:41.295401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.295886 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.296654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.297082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.412656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:41.414058 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:41.438210 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.447677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.448638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.449817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.470024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:41.473640 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:41.491145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7267fc64-1ad4-42fa-a19c-262c5c059721 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.206532 Jul 26 15:05:41.491848 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 60/107] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:41 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:41.638298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:41.646154 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4a040de8-d362-46b5-8845-f998fea4a5da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.241043 Jul 26 15:05:41.646731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 48/108] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:41 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:41.741786 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:41.742717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:41.751861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.752580 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.753582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.754036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.945478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:41.954225 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a20051ad-a5d6-4c9b-b59a-96c524224c56 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.216142 Jul 26 15:05:41.956803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 61/109] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:41 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:42.058854 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:42.059715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:42.066911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.067348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.068163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.068590 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.346844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:42.362362 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c730a604-c682-4cae-bf39-db69f4dc9ca1 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.308582 Jul 26 15:05:42.363169 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 49/110] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:42 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:42.515772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:42.516409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:42.523435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.525090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.526204 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.526750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.686881 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:42.692925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:42.706474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.707358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.708255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.708695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.782835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:42.803690 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-375eecc6-5e76-4ace-b5f7-83380206b12b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.284589 Jul 26 15:05:42.803690 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 62/111] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:42 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:42.897563 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:42.907162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5b0006c0-c8e6-4b73-9e00-ce965e9df5e6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.230569 Jul 26 15:05:42.907612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 50/112] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:42 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:42.993512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:42.994809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:43.009627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.010155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.010943 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.011381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.202778 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:43.217022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7258a8b0-2116-45cd-b7ae-e96c0c8fc010 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.234309 Jul 26 15:05:43.219158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 63/113] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:42 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:43.400532 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:43.401359 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:43.407884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.408429 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.409240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.409674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.588771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:43.600703 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8f2b4cd2-74ce-4102-b05c-c936eaa06d5d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.204231 Jul 26 15:05:43.601839 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 51/114] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:43 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:43.821621 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:43.823073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:43.829586 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.830031 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.830869 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.831301 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.935691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:43.936973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:43.945326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.946511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.948266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.949021 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.103999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:44.103999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-502afde5-139e-43ad-add7-e55920c4152b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.264124 Jul 26 15:05:44.103999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 64/115] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:43 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:44.267350 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:44.268761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:44.289814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.291111 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.293024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.294213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.469504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:44.481026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-40d50fe6-8864-4e51-826a-4d3d56c1b6dd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.553845 Jul 26 15:05:44.573708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 52/116] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:43 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:44.574201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:44.574201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-75212b10-dcfe-46bc-9d38-f452af07b278 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.274741 Jul 26 15:05:44.574201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 65/117] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:44 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:44.629565 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:44.630847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:44.642488 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.643540 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.645360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.646090 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.137499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:45.148088 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:45.173118 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.175948 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.181899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.183151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.352710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:45.369637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-471303b9-6d98-40b1-b663-39d77ecd97f5 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.748775 Jul 26 15:05:45.370876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 53/118] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:44 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:45.398349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:45.407289 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-75638607-92f7-447f-b719-69223dae589c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.278442 Jul 26 15:05:45.420854 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 66/119] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:45 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:45.602163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:45.603404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:45.610686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:45.611318 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:45.628148 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.630363 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.630817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.631782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.632227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.633870 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.635192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.635833 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.843068 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:45.846895 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:45.865987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e96159da-de65-4d2c-9916-207fae984919 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.268231 Jul 26 15:05:45.874708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-27e4380f-a491-4b5c-a71c-5dc66886b463 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.268066 Jul 26 15:05:45.875298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 67/120] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:45 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:45.883905 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 54/121] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:45 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:46.395797 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:46.397189 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:46.405587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.406579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.407891 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.408597 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.431931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:46.432733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:46.440434 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.440931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.441985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.442580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.669629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:46.682246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-64288b8a-154e-4563-a6f5-6184c3bf616a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.293167 Jul 26 15:05:46.694226 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 68/122] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:46 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:46.699664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:46.709312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-99865194-36b8-4b13-80e2-874b3dc7d9f3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.281970 Jul 26 15:05:46.710956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 55/123] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:46 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:46.891696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:46.895763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:46.907585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.911656 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.912915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.923725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.924067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:46.932333 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:46.951858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.952848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.967139 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.967139 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.219052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:47.249999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-11197ab2-0776-43e0-ba94-9638f0ae84e4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.357408 Jul 26 15:05:47.254976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 69/124] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:46 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:47.276853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:47.288157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a4dcd479-1590-4c6c-b4d2-93c2fa0364eb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.375104 Jul 26 15:05:47.291534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 56/125] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:46 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:47.738544 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:47.739614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:47.754218 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.754649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.755483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.755921 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.816693 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:47.925972 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:47.953341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-608a8a3a-2bb2-4f10-bfe3-0bbad9f61d77 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.229789 Jul 26 15:05:47.955204 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 57/126] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:47 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:47.965198 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:47.966695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:47.979050 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.980772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.982469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.983528 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.109842 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-4f63126f-4000-4078-8299-42b71977caa2 req-36f5a563-1ea5-46eb-8144-d7dd5dbb2b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe50a6b-2228-43d7-be82-df26fcab6088", "name": "network-vif-plugged", "status": "completed", "tag": "498672af-1542-4fdd-8bf4-5a5c5cabe7ca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:48.122281 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-4f63126f-4000-4078-8299-42b71977caa2 req-36f5a563-1ea5-46eb-8144-d7dd5dbb2b7c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.122977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-4f63126f-4000-4078-8299-42b71977caa2 req-36f5a563-1ea5-46eb-8144-d7dd5dbb2b7c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.138007 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-4f63126f-4000-4078-8299-42b71977caa2 req-36f5a563-1ea5-46eb-8144-d7dd5dbb2b7c service nova] Creating event network-vif-plugged:498672af-1542-4fdd-8bf4-5a5c5cabe7ca for instance 7fe50a6b-2228-43d7-be82-df26fcab6088 on hv-cinder-85066 Jul 26 15:05:48.143860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-4f63126f-4000-4078-8299-42b71977caa2 req-36f5a563-1ea5-46eb-8144-d7dd5dbb2b7c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421154 Jul 26 15:05:48.145102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 70/127] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:48.219035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:48.232120 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-215bc0ae-3096-4936-b89f-bddcfc92e957 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.274595 Jul 26 15:05:48.233075 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 58/128] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:47 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:48.278801 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:48.280256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:48.287563 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.288367 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.289808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.290838 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.311110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:48.312043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:48.318380 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.319137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.320151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.321366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.443045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:48.452499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a5d387da-5da3-4b77-8959-6ced5f0e6296 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.179252 Jul 26 15:05:48.453068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 71/129] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:48 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:48.501393 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:48.513763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5c83ea04-0a38-4cff-a169-1e2bfd732053 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.206270 Jul 26 15:05:48.514572 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 59/130] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:48 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:48.995137 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:48.995803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.004489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.005116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.006101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.006537 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.185959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.190818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ffe8e281-a325-46b7-8a7d-a3098757c73d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.200274 Jul 26 15:05:49.191608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 72/131] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:48 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:49.258313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:49.258981 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.269044 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.269633 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.270811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.273991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.454620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.462648 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-978ee946-ae2a-4b8e-9261-fcc48bf21c07 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.209900 Jul 26 15:05:49.463323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 60/132] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:49 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:49.484791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:49.485415 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.494818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.494818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.494818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.494818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.540484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:49.541134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.548460 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.548460 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.549267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.549691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.672644 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.680753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a5ad5894-8d01-427e-8a33-d76232c3c15c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.199338 Jul 26 15:05:49.681334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 73/133] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:49 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:49.720092 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.728357 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e3b04ca4-8680-4d36-9c67-7ae923ec2565 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.192148 Jul 26 15:05:49.728938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 61/134] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:49 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:50.213752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:50.214440 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:50.220963 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.221412 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.222195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.222628 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.414262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:50.428562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1597cea1-dd6e-4536-b58c-c1d0fc25dba8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.218772 Jul 26 15:05:50.429393 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 74/135] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:50 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:50.493125 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:50.496017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:50.500664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.501113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.501896 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.502536 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.705798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:50.706461 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:50.707298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:50.726028 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:50.730806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.733888 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.735084 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.735737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.738444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a3cf5bdf-f099-4433-b47f-205bbbc8593a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.249004 Jul 26 15:05:50.742212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 62/136] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:50 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:50.779397 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:50.786124 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:50.816084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.816822 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.819898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.821792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.092019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:51.100452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-48173b87-1690-4cdc-8945-9bb7b9707b3a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.345789 Jul 26 15:05:51.101550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 63/137] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:50 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:51.177741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:51.188184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0007cab4-8ece-4da7-b3c9-9a2fb378f4f6 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.486279 Jul 26 15:05:51.188914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 75/138] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:50 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:51.451436 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:51.453098 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:51.459874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.460323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.461152 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.462190 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.721366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:51.730066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2cfbdd92-e4fc-4039-9370-bdbe9481dde8 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.282836 Jul 26 15:05:51.730641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 64/139] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:51 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:51.777517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:51.778128 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:51.786710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.787154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.788961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.788961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.127243 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:52.127880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:52.135503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:52.135960 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.136729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:52.139641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.168712 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:52.209679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:52.219411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-971b2ccf-8be1-4268-8270-4a80c10a16d9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.446107 Jul 26 15:05:52.224087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 76/140] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:51 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:52.230893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:52.231627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:52.238881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:52.239426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.240378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:52.241298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.250368 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:52.343819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:52.351490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-49b94531-a6f1-4782-994f-36dd85451ac1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.227917 Jul 26 15:05:52.352358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 65/141] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:52 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:52.398423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:52.405000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e716a7d2-78bd-445b-b812-e86906d7bae4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.179686 Jul 26 15:05:52.405569 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 77/142] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:52 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:52.754030 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:52.763739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:52.763739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:52.763739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.763739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:52.764110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:52.936655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:52.944603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fe56a57a-f4b4-46f9-86c0-21c207fe7473 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.195374 Jul 26 15:05:52.959868 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 66/143] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:52 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:53.247860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.248768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.257045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.257631 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.260478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.261124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.373600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.374408 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.381804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.381804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.382939 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.383593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.420400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:53.428445 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4c1a8b10-3814-4cba-8d79-d009cff5cc8e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.186782 Jul 26 15:05:53.429603 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 78/144] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:53.465890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.465890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.465890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.465890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.466256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.466256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.539670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:53.548474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a768a320-56bd-4ce2-a661-f557d4e2e298 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.178980 Jul 26 15:05:53.549214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 67/145] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:53.605756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:53.616194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-72e3ccc9-2150-4f93-a3ce-d8234e012ecd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.184545 Jul 26 15:05:53.617530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 79/146] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:53.967403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.968027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.974130 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.974813 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.978423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.978423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.141669 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:54.151772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2ede4302-e6f2-4643-8048-a5f8f95577af tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.187862 Jul 26 15:05:54.152860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 68/147] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:54.452134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:54.452856 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:54.461686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.462145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.463064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.463578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.574546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:54.574546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:54.577727 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.578064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.578830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.579262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.620512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:54.623517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c07da836-fb65-47f3-bb44-f9130dada538 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.175223 Jul 26 15:05:54.624156 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 80/148] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:54 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:54.639790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:54.639790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:54.646141 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.648913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.648913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.648913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.741655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:54.751877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d05cd35c-b66b-43c8-a7ac-3fe419d26784 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.185515 Jul 26 15:05:54.752949 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 69/149] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:54 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:54.807938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:54.813895 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-dfa5fe8f-9b76-49eb-b631-3a9093440fe5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.179040 Jul 26 15:05:54.814456 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 81/150] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:54 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:55.175504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:55.176120 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:55.183294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.183781 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.184582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.185008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.358615 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:55.366320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b342be49-8eeb-4b06-b6b8-364bd7c7af37 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.194717 Jul 26 15:05:55.367085 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 70/151] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:55 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:55.644950 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:55.645562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:55.652361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.652819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.653591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.654021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.774671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:55.775703 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:55.782200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.782728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.783599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.784133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.795785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:55.804851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-904b5ff2-22c2-48e7-b536-cf16c960d664 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.163718 Jul 26 15:05:55.805543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 82/152] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:55 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:55.840038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:55.840852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:55.848257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.848856 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.849732 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:55.850267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.944347 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:55.955696 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b3e268ab-f49b-41b5-a91c-44a1d3ecc87b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.185526 Jul 26 15:05:55.962350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 71/153] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:55 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:56.003537 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:56.012420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6903f1f5-2db5-4a0b-80b8-4971719f4a59 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.177091 Jul 26 15:05:56.012978 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 83/154] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:55 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:56.204204 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-d8e50b32-bc16-4b95-af08-a743c03736eb req-96cb4c58-4f80-4c29-b931-b3ce09ce47a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e94e2c3-8b57-4a91-831d-7afb4e64dcaf", "name": "network-vif-plugged", "status": "completed", "tag": "957f7279-c7e0-4980-871c-ba5e2033c52a"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:56.214564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-d8e50b32-bc16-4b95-af08-a743c03736eb req-96cb4c58-4f80-4c29-b931-b3ce09ce47a5 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.214998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-d8e50b32-bc16-4b95-af08-a743c03736eb req-96cb4c58-4f80-4c29-b931-b3ce09ce47a5 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.226260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-d8e50b32-bc16-4b95-af08-a743c03736eb req-96cb4c58-4f80-4c29-b931-b3ce09ce47a5 service nova] Creating event network-vif-plugged:957f7279-c7e0-4980-871c-ba5e2033c52a for instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf on hv-cinder-85066 Jul 26 15:05:56.231926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-d8e50b32-bc16-4b95-af08-a743c03736eb req-96cb4c58-4f80-4c29-b931-b3ce09ce47a5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031731 Jul 26 15:05:56.232551 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 72/155] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:56.390608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:56.391238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:56.397723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.398201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.398981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.399418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.560583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:56.570082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6b2b812c-5674-4d1a-bb57-a69562a7ec83 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.183301 Jul 26 15:05:56.582958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 84/156] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:56 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:56.827371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:56.828263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:56.834899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.835600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.838521 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.839376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.978183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:56.979434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:56.986751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.987198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.987995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.988457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.019745 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:57.030665 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-40b9c52e-7754-48b6-8e29-aa3aa898e6ad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.207604 Jul 26 15:05:57.037901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 73/157] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:56 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:57.046405 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:57.047141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:57.057428 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:57.057978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.059119 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:57.060941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.165553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:57.174276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a7ea098f-a160-4ab5-a35d-a342110c579c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.200707 Jul 26 15:05:57.177924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 85/158] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:56 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:57.241409 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:57.271060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6a906cb8-83e7-442f-be48-5fe041b02080 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.231765 Jul 26 15:05:57.283956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 74/159] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:57 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:57.591937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:57.592557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:57.598902 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:57.599519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.600209 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:57.600664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.748515 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:57.762980 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-df29ea02-f83f-495b-a8c1-7a7440ee257a tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.174461 Jul 26 15:05:57.764087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 86/160] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:57 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:58.052983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:58.053620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:58.060785 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.064202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.064202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.064202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.206952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:58.207413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:58.208220 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:58.215484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.216074 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.216268 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4e593ba9-08c1-4a0c-a67f-dbb8e6faa2cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.167256 Jul 26 15:05:58.217006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 75/161] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:58 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:58.217129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.217641 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.248965 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-aebfbd69-9d43-47eb-a670-38e19e5f7918 req-81519ab1-50bf-40c7-938c-a3e96a17da79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06447f6-a112-4dc5-96aa-87f3189a038e", "name": "network-vif-plugged", "status": "completed", "tag": "18c5b7fd-eaad-4eca-8964-f04ead1ce7f7"}, {"server_uuid": "ebca4e54-4a78-49e4-b381-6cd1203b3535", "name": "network-vif-plugged", "status": "completed", "tag": "0552bdab-a714-4a7a-a202-96df45a02287"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:58.261689 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-aebfbd69-9d43-47eb-a670-38e19e5f7918 req-81519ab1-50bf-40c7-938c-a3e96a17da79 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.262342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-aebfbd69-9d43-47eb-a670-38e19e5f7918 req-81519ab1-50bf-40c7-938c-a3e96a17da79 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.278637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-aebfbd69-9d43-47eb-a670-38e19e5f7918 req-81519ab1-50bf-40c7-938c-a3e96a17da79 service nova] Creating event network-vif-plugged:18c5b7fd-eaad-4eca-8964-f04ead1ce7f7 for instance c06447f6-a112-4dc5-96aa-87f3189a038e on hv-cinder-85066 Jul 26 15:05:58.279326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-aebfbd69-9d43-47eb-a670-38e19e5f7918 req-81519ab1-50bf-40c7-938c-a3e96a17da79 service nova] Creating event network-vif-plugged:0552bdab-a714-4a7a-a202-96df45a02287 for instance ebca4e54-4a78-49e4-b381-6cd1203b3535 on hv-cinder-85066 Jul 26 15:05:58.287783 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-aebfbd69-9d43-47eb-a670-38e19e5f7918 req-81519ab1-50bf-40c7-938c-a3e96a17da79 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043010 Jul 26 15:05:58.288422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 76/162] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:05:58.297319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:58.298139 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:58.310612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.310612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.310612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.310612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.384556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:58.392500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e179b617-57eb-4e65-a319-28b47150597b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.189008 Jul 26 15:05:58.392959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 87/163] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:58 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:58.452941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:58.460918 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c954cc17-29a5-412e-9537-88839d961725 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.167994 Jul 26 15:05:58.461574 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 77/164] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:58 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:58.784628 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:58.785362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:58.792026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.792557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.793430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.793799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.938232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:58.948262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1c0a0fa4-71b6-416d-a34e-32eb69123aa6 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1315 microversion: 2.1 time: 0.167739 Jul 26 15:05:58.949594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 88/165] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:58 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:59.238021 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:59.238657 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:59.246356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.246356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.252378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.252378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.390539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:59.399323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1e33097f-779c-4a0f-94ec-14d3111ab866 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.165165 Jul 26 15:05:59.399933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 78/166] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:59 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:59.414499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:59.415163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:59.421582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.422031 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.422797 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.423568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.486870 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:59.487497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:59.497664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.497664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.500361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.501130 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.584311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:59.594757 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4a3fd1d2-4970-4335-a3f3-35b72cdd83c1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.185257 Jul 26 15:05:59.595954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 89/167] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:59 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:59.714178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:59.717703 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b5437c92-0978-4e8f-9f77-ed21ad983fe9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.236450 Jul 26 15:05:59.718529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 79/168] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:59 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:59.969703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:59.970338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:59.983625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.984317 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.985254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.985679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.190642 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:00.201062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-101a6df1-5f5b-4e28-bcc8-0336e45310c0 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1501 microversion: 2.1 time: 0.235244 Jul 26 15:06:00.212806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 90/169] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:59 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:00.425052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:00.425951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:00.434881 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.435370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.436368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.436836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.619322 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:00.621181 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:00.628788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.629438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.630222 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.630825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.635030 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:00.644343 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fad9a89c-3909-463d-9fb5-8d974251d9c9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.225118 Jul 26 15:06:00.646059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 80/170] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:00 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:00.743743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:00.744831 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:00.753462 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.753909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.754738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.755375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.795019 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:00.803293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7c3e6036-362f-404e-a595-134484f6fef4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.189094 Jul 26 15:06:00.803912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 91/171] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:00 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:00.904750 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:00.913073 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9229497a-09c4-4b5a-84bf-4dfb17198825 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.173989 Jul 26 15:06:00.915513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 81/172] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:00 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:01.301075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-5ffbbd0b-0c1d-42aa-afe2-4b4c27adf655 req-709644bf-1c9b-43a0-b92f-a0d1009c3446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d42296f-f3c6-4b95-999e-7b15b6537bfd", "name": "network-vif-plugged", "status": "completed", "tag": "e9809239-4b3d-4ebd-a706-267b3a41b7eb"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:01.324320 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-5ffbbd0b-0c1d-42aa-afe2-4b4c27adf655 req-709644bf-1c9b-43a0-b92f-a0d1009c3446 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.325095 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-5ffbbd0b-0c1d-42aa-afe2-4b4c27adf655 req-709644bf-1c9b-43a0-b92f-a0d1009c3446 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.353427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-5ffbbd0b-0c1d-42aa-afe2-4b4c27adf655 req-709644bf-1c9b-43a0-b92f-a0d1009c3446 service nova] Creating event network-vif-plugged:e9809239-4b3d-4ebd-a706-267b3a41b7eb for instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd on hv-cinder-85066 Jul 26 15:06:01.363924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-5ffbbd0b-0c1d-42aa-afe2-4b4c27adf655 req-709644bf-1c9b-43a0-b92f-a0d1009c3446 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070283 Jul 26 15:06:01.365411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 92/173] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:01.674748 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:01.677314 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:01.688236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.689200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.690503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.691280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.833005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:01.833805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:01.846426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.847825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.848939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.850084 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.969526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:01.984370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-277bbb7d-559a-4911-9979-13faf0edcf40 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1322 microversion: 2.1 time: 0.320872 Jul 26 15:06:01.990317 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 82/174] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:01 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:01.996242 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:01.996776 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:02.014085 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:02.015619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.016076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.016832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.017263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.021673 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:02.079858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:02.089604 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-acd711a4-b1a3-4d5e-a7d7-d5251eaca5de tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.262328 Jul 26 15:06:02.090195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 93/175] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:01 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:02.170032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:02.178834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-759518d0-d893-43b0-be65-8a5cb8180475 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.187175 Jul 26 15:06:02.182520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 83/176] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:01 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:02.341711 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba72dab-0f55-4533-83c1-d136c04535c6"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:02.344063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:02.349978 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.350413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.351311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.351949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.408038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:03.008558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:03.009290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:03.015944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.016395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.017170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.017605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.238732 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:03.247690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0707ed45-b159-43d1-884f-8ebcfe9cbd9b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1516 microversion: 2.1 time: 0.244222 Jul 26 15:06:03.260717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 84/177] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:03 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:03.267874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:03.269047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:03.278864 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.279594 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.280531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.280975 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.441220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:03.449107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-087b9606-7a39-41cf-88cb-b0b5b91fb24d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.186330 Jul 26 15:06:03.449676 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 85/178] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:03 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:03.454078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:03.454849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:03.465657 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.466113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.466997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.467430 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.618809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:03.626526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6cdf41ff-cb80-4520-9545-a1a3be1688e1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.175802 Jul 26 15:06:03.627114 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 86/179] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:03 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:03.644794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:03.647079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:03.655416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.655416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.655961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:03.656390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:03.719601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'flavor' on Instance uuid c06447f6-a112-4dc5-96aa-87f3189a038e {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:06:04.123499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b6b82c24-46ab-479d-9dc4-587b7cd042f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e/action" status: 200 len: 32 microversion: 2.1 time: 0.494856 Jul 26 15:06:04.124199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 87/180] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:06:03 2022] POST /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e/action => generated 32 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:06:04.137277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:04.137969 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:04.145128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.145571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.151114 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.151114 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.316149 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:04.329821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a6b8677f-644f-4b3c-a883-d1140deaa70a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.197378 Jul 26 15:06:04.330473 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 88/181] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:04 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:04.470876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:04.471591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:04.478621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.479073 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.479911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.480340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.650832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:04.660070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-29b28913-d7ed-4e74-ae8e-76c6590cb27c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.193151 Jul 26 15:06:04.660903 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 89/182] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:04 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:04.668836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:04.669427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:04.677020 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.677458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.678230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.678661 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.823855 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:04.831879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8fbbe87d-f1b3-4022-85e9-8665fbda7c49 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.169705 Jul 26 15:06:04.832469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 90/183] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:04 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:05.360664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:05.361480 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:05.369930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:05.370719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:05.371929 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:05.372904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:05.547400 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:05.558718 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-36892e1c-12ff-4076-a3e1-7a03c4937f91 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.201926 Jul 26 15:06:05.572110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 91/184] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:05 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:05.688207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:05.688920 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:05.697495 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:05.698396 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:05.699619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:05.703699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:05.887697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:05.908138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4839db57-c720-454a-a0d8-ab11eb85fb88 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1365 microversion: 2.1 time: 0.213444 Jul 26 15:06:05.908138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 92/185] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:05 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:05.908138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:05.908138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:05.917787 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:05.918303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:05.919147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:05.919727 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:06.105634 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:06.117728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-30264087-8323-40a7-9644-0d0f3918aaf5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.212173 Jul 26 15:06:06.120877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 93/186] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:05 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:06.584038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:06.585039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:06.595767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:06.595767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:06.596526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:06.596926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:06.757997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:06.770305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3c03c84f-8730-4045-ba08-194e77191031 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.192010 Jul 26 15:06:06.771098 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 94/187] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:06 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:06.921534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:06.922178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:06.928641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:06.929110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:06.929874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:06.930305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.098298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:07.106944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-50b7d353-4c9a-4796-bd08-9da6b3983d27 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1556 microversion: 2.1 time: 0.189730 Jul 26 15:06:07.107522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 95/188] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:06 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:07.131231 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:07.132082 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:07.145104 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:07.151133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.151133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:07.151133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.254427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e6a67daa-2f8d-4fa3-bc1a-ca486aa34020 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127481 Jul 26 15:06:07.255023 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 96/189] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:06:07 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:07.260811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:07.261457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:07.275034 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:07.275499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.276316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:07.276772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.434910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:07.447274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0d67d184-8420-438c-b441-5744d6d6869b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.189030 Jul 26 15:06:07.447999 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 97/190] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:07 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:07.800744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:07.803117 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:07.813776 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:07.814871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.816608 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:07.817273 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:07.824249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:08.259445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:08.274290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7852434a-0c38-406e-b57d-dc42d9cb028a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.481118 Jul 26 15:06:08.287498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 98/191] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:07 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:08.470276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:08.471287 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:08.481263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:08.482160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:08.483151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:08.484085 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:08.613322 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-56756b08-0348-48cb-b1b3-39e972658735 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "POST /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.275284 Jul 26 15:06:08.614994 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 94/192] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:06:02 2022] POST /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088/os-volume_attachments => generated 194 bytes in 6278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:08.754684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:08.763119 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ad3d08ce-2aa6-4a4b-afc8-27812b3e6b27 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.297954 Jul 26 15:06:08.767558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 99/193] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:08 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:09.203343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-2c4ebc84-077b-4a1d-9776-61e967156924 req-27f0cec7-7e6d-4914-b24e-a17455b8a965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e94e2c3-8b57-4a91-831d-7afb4e64dcaf", "tag": "957f7279-c7e0-4980-871c-ba5e2033c52a"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:09.236850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-2c4ebc84-077b-4a1d-9776-61e967156924 req-27f0cec7-7e6d-4914-b24e-a17455b8a965 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:09.240665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-2c4ebc84-077b-4a1d-9776-61e967156924 req-27f0cec7-7e6d-4914-b24e-a17455b8a965 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:09.289566 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-2c4ebc84-077b-4a1d-9776-61e967156924 req-27f0cec7-7e6d-4914-b24e-a17455b8a965 service nova] Creating event network-changed:957f7279-c7e0-4980-871c-ba5e2033c52a for instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf on hv-cinder-85066 Jul 26 15:06:09.300959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-2c4ebc84-077b-4a1d-9776-61e967156924 req-27f0cec7-7e6d-4914-b24e-a17455b8a965 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099962 Jul 26 15:06:09.302601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 95/194] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:09.309591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:09.312864 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:09.326392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:09.327828 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:09.328988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:09.329767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:09.566055 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:09.577224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-74ab2d24-2dce-4f05-a3e4-06a545f90400 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.281206 Jul 26 15:06:09.586230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 100/195] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:09 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:09.785853 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:09.786827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:09.801295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:09.802980 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:09.805175 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:09.806615 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:10.087154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:10.096463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-18d8a91c-c75a-451e-9f56-d25eef7e8487 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1363 microversion: 2.1 time: 0.315394 Jul 26 15:06:10.097040 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 96/196] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:09 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:10.629033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:10.629033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:10.629033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:10.629033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:10.630158 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:10.630158 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:10.892097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:10.901876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-647b4a08-c7b9-405a-9679-e1966124f98c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.298915 Jul 26 15:06:10.902467 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 101/197] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:10 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:11.121052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:11.122859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:11.128657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:11.129277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:11.130069 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:11.130691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:11.330019 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:11.333047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d8cb1e57-7ba5-4843-b03e-8e0390d63963 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1549 microversion: 2.1 time: 0.218021 Jul 26 15:06:11.334167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 97/198] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:11 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1549 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:11.355839 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:11.359442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:11.363015 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:11.363445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:11.364250 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:11.364678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:11.445794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-68766657-ddb9-420b-a66e-88315ed5a8e3 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093783 Jul 26 15:06:11.446474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 102/199] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:06:11 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:11.922949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:11.923579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:11.932223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:11.933000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:11.934069 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:11.934500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:12.121735 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:12.129613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c5a3d2fd-f0a3-41de-b0a0-910673e3324c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.210716 Jul 26 15:06:12.130187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 98/200] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:11 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:13.091337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-1e14f2b5-2990-47be-824f-b207d73174a1 req-a835d589-2aaf-4014-8046-5ba10fda48d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d42296f-f3c6-4b95-999e-7b15b6537bfd", "tag": "e9809239-4b3d-4ebd-a706-267b3a41b7eb"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:13.114866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-1e14f2b5-2990-47be-824f-b207d73174a1 req-a835d589-2aaf-4014-8046-5ba10fda48d2 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:13.120442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-1e14f2b5-2990-47be-824f-b207d73174a1 req-a835d589-2aaf-4014-8046-5ba10fda48d2 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:13.139835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-1e14f2b5-2990-47be-824f-b207d73174a1 req-a835d589-2aaf-4014-8046-5ba10fda48d2 service nova] Creating event network-changed:e9809239-4b3d-4ebd-a706-267b3a41b7eb for instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd on hv-cinder-85066 Jul 26 15:06:13.154343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:13.155020 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:13.159731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-1e14f2b5-2990-47be-824f-b207d73174a1 req-a835d589-2aaf-4014-8046-5ba10fda48d2 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063167 Jul 26 15:06:13.162105 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 103/201] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:06:13.164709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:13.165751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:13.166884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:13.167654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:13.407646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:13.423108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ae3e7970-36c0-4ac0-a133-10afb7b98282 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.272687 Jul 26 15:06:13.423877 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 99/202] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:13 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:14.456333 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:14.457024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:14.470593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:14.471041 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:14.471848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:14.472278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:14.705349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:14.723845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ab7f9697-e182-44f9-8664-2f74c9ccc647 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.264244 Jul 26 15:06:14.723845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 104/203] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:14 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:15.741658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:15.742268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:15.749264 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:15.749709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:15.750467 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:15.750901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:15.903162 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:15.912530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a0436ef1-3447-40a9-b4e6-f44b0acc74a4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.174835 Jul 26 15:06:15.922394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 100/204] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:15 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:16.935624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:16.936246 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:16.942384 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:16.946553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:16.946553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:16.946553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:17.080377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:17.089185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-92c28978-84e1-4e89-ab5b-171105f25da6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.158060 Jul 26 15:06:17.089774 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 105/205] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:16 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:18.111153 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:18.112420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:18.119896 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:18.123145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:18.123145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:18.123145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:18.277113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:18.285145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5d138d33-ab14-4932-b523-0a77351a7009 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.177928 Jul 26 15:06:18.285720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 101/206] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:18 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:19.315826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:19.316663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:19.323662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:19.324241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:19.325128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:19.325662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:19.485605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:19.494463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-427528e5-20cd-44e7-b66b-61dbccb00558 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.189311 Jul 26 15:06:19.495336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 106/207] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:19 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:20.516834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:20.517929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:20.525093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:20.525657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:20.526591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:20.527023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:20.683030 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:20.692636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-16a21611-b580-4159-a8c4-a0c34328fb3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.179544 Jul 26 15:06:20.693427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 102/208] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:20 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:21.476313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:21.476996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:21.490176 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:21.490824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:21.492789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:21.493472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:21.539998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:06:21.729645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:21.730649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:21.738669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:21.739261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:21.740068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:21.740500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:21.920900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d62b1d8d-b8ab-4334-9e94-fba30843f6bd tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "DELETE /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 204 len: 0 microversion: 2.1 time: 0.450677 Jul 26 15:06:21.922895 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 107/209] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:06:21 2022] DELETE /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:06:21.934496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:21.935561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:21.938673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:21.943187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:21.945566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:21.946902 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:21.947672 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:21.951656 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fde8a2c1-3b3f-4cab-82ad-9401b12c5256 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.227998 Jul 26 15:06:21.952931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 103/210] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:21 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:22.110276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:22.120535 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-11d02e4b-e027-4666-8715-e35cf4f753bb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1553 microversion: 2.1 time: 0.191930 Jul 26 15:06:22.129064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 108/211] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:21 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:22.651315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1467443327", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "networks": [{"uuid": "f592bdd4-ff36-4285-b3a5-96166a7a017a"}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:22.661712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=57 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:22.723713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] validate_networks() for [('f592bdd4-ff36-4285-b3a5-96166a7a017a', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:06:22.975129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:22.976488 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:22.984707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:22.985483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:22.986505 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:22.987217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:23.172041 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:06:23.173965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:06:23.174446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:06:23.175414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:06:23.177236 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:06:23.193429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:23.194910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:23.196099 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:23.198703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:23.198703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:23.205145 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8603d793-5e21-4485-89ce-d2e3baae3862 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.234694 Jul 26 15:06:23.219451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 109/212] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:22 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:23.225061 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:23.226454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:23.233281 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:23.234284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:23.234485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:23.235172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:23.245284 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Getting quotas for project 4272758d01274f419bc75c85140daa06. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:06:23.251733 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Getting quotas for user 2bf28a5c061c42668fc54a0c50af64ee and project 4272758d01274f419bc75c85140daa06. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:06:23.283663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:06:23.289142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:06:23.406403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:23.417626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f67e37ea-5b02-4256-8906-7ff89599b404 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1553 microversion: 2.1 time: 0.196581 Jul 26 15:06:23.418259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 110/213] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:23 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:23.445174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d50adf0f-f1e0-4e61-ba57-db6c14b41cf9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801314 Jul 26 15:06:23.445821 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 104/214] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:06:23.467968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-288150c4-f720-4392-8e0a-e8dcfc157058 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:23.468806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-288150c4-f720-4392-8e0a-e8dcfc157058 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:23.540747 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-288150c4-f720-4392-8e0a-e8dcfc157058 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:23.547895 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-288150c4-f720-4392-8e0a-e8dcfc157058 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1214 microversion: 2.1 time: 0.085895 Jul 26 15:06:23.548474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 111/215] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:23 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:24.226858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:24.227680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:24.237157 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:24.237605 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:24.238374 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:24.238807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:24.394568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:24.405288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-76e65c9c-34f6-4b6b-9ffd-44777c35a478 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.182842 Jul 26 15:06:24.405873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 105/216] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:24 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:24.443902 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:24.446486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:24.454741 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:24.455217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:24.456355 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:24.456833 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:24.569477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ff8a9a97-b4f1-4654-b1ed-d0e8f1b8d545 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:24.570568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ff8a9a97-b4f1-4654-b1ed-d0e8f1b8d545 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:24.644656 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ff8a9a97-b4f1-4654-b1ed-d0e8f1b8d545 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:24.645616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:24.653400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ff8a9a97-b4f1-4654-b1ed-d0e8f1b8d545 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1214 microversion: 2.1 time: 0.087743 Jul 26 15:06:24.654428 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 106/217] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:24 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:24.655032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-76a134c8-55c5-4a86-954b-b83d2834aadb tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1553 microversion: 2.1 time: 0.218570 Jul 26 15:06:24.656700 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 112/218] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:24 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:25.429911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:25.430677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:25.439843 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:25.440195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:25.440983 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:25.441446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:25.584066 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:25.596418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d9e80b5a-0f7a-4964-866b-4c3f387221b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.170743 Jul 26 15:06:25.597020 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 107/219] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:25 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:25.678959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:25.679845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:25.681234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:25.682176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:25.688424 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:25.690490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:25.691011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:25.691856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:25.692288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:25.696516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:25.697343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:25.697799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:25.795566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:25.800361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7265cb93-67d3-4a16-81b0-d569835bc58a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1218 microversion: 2.1 time: 0.125868 Jul 26 15:06:25.801547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 113/220] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:25 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:25.898354 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:25.907746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2df136e8-ffb8-47a8-932e-7fbe3f728399 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1553 microversion: 2.1 time: 0.233079 Jul 26 15:06:25.908345 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 108/221] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:25 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:26.626464 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:26.627080 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:26.634293 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:26.634761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:26.635558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:26.636201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:26.826649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:26.828056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:26.828763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:26.837458 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:26.837949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:26.838867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:26.839404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:26.877280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6a072915-2587-4fe3-b70e-d0f7eb0ac1a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.254210 Jul 26 15:06:26.879240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 114/222] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:26 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:26.940493 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:26.941134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:26.947650 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:26.948410 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:26.949368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:26.950032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:26.957149 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:26.990164 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:27.000808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4898b133-6899-4655-84af-8bd2a6c4da05 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1210 microversion: 2.1 time: 0.176259 Jul 26 15:06:27.013146 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 109/223] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:26 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1210 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:27.134538 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:27.149795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-48dab6ec-1fa5-4b0c-a9f6-c17c04f94573 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1553 microversion: 2.1 time: 0.208615 Jul 26 15:06:27.149795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 115/224] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:26 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:27.807977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-576f63b0-510c-4eab-8f81-922c29025266 req-e54a175e-5999-4f82-8910-6a5dcc65cb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe50a6b-2228-43d7-be82-df26fcab6088", "name": "network-vif-deleted", "tag": "498672af-1542-4fdd-8bf4-5a5c5cabe7ca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:27.837178 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-576f63b0-510c-4eab-8f81-922c29025266 req-e54a175e-5999-4f82-8910-6a5dcc65cb89 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:27.840919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-576f63b0-510c-4eab-8f81-922c29025266 req-e54a175e-5999-4f82-8910-6a5dcc65cb89 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:27.852972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-576f63b0-510c-4eab-8f81-922c29025266 req-e54a175e-5999-4f82-8910-6a5dcc65cb89 service nova] Creating event network-vif-deleted:498672af-1542-4fdd-8bf4-5a5c5cabe7ca for instance 7fe50a6b-2228-43d7-be82-df26fcab6088 on hv-cinder-85066 Jul 26 15:06:27.861997 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-576f63b0-510c-4eab-8f81-922c29025266 req-e54a175e-5999-4f82-8910-6a5dcc65cb89 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067464 Jul 26 15:06:27.863122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 110/225] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:27.899499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:27.900073 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:27.919179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:27.919985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:27.920871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:27.921215 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:28.028513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:28.030163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:28.046945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:28.049135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:28.050316 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:28.054934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:28.170107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:28.182056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3c00101f-f2ed-44ae-89c6-4c01bc30513f tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1266 microversion: 2.1 time: 0.162417 Jul 26 15:06:28.182939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 111/226] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:28 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:28.188111 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:28.188610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:28.212879 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:28.216915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:28.218582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:28.222441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:28.239216 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:28.257308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cb725e8c-84d7-491e-a6ef-35886e188611 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.361407 Jul 26 15:06:28.258635 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 116/227] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:27 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:28.310154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:28.316276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:28.326877 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e7bf2345-47f9-4e77-b878-de1a8ea9f167 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1346 microversion: 2.1 time: 0.142391 Jul 26 15:06:28.327982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 112/228] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:28 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:29.220762 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:29.228547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:29.247138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.247824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.248834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.249332 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.282223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:29.283207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:29.292231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.292670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.293446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.295045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.329079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:29.343171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d94226dd-4ed8-42c8-8591-bab59776cf2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1272 microversion: 2.1 time: 0.137500 Jul 26 15:06:29.343624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 117/229] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:29 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:29.349035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:29.349653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:29.356923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.357390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.358151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.358586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.394865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:29.395334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:29.395774 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lazy-loading 'fault' on Instance uuid 7fe50a6b-2228-43d7-be82-df26fcab6088 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:06:29.450450 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15d08b7eb014af3afc4d0a6e032f740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb18a5955f814887bcfa9650bcaa2ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:29.461715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:29.463269 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-19753bde-5594-452c-9a43-63510b5e2945 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 200 len: 1351 microversion: 2.1 time: 0.118213 Jul 26 15:06:29.463907 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 118/230] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:29 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:29.470483 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d35a8205-2f54-463b-b40e-8b9425cd79cc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.193505 Jul 26 15:06:29.471300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 113/231] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:29 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:30.371395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:30.372406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:30.378884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.379326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.380148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.380589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.502298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:30.505898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:30.548262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.549506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.551245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.552438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.578534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] HTTP exception thrown: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.583219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:30.598398 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2ce5c686-883a-4f2a-bfda-a61686439ba2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.231363 Jul 26 15:06:30.601319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 119/232] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:30 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:30.609271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:30.609978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Request method failure captured: Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 HTTP/1.1 Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKg1Cofzw0Z1oPIdL62YhViPHFWM68vQjw71xjG-ciHvYxXPqAhbhlXgg2ed8HujkYcXAQnvG_cQ_bIAnmxPNt8mCnTmFoKHj9Lz_NCyzI4fOyQ_XmDy88i6Gl7SDdQeCJWj4moYmq8u1ePnC0NRiiwJVuVZYfchBAVrSpZll1wo3o Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:30.610926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: c15d08b7eb014af3afc4d0a6e032f740 Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.612339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '7fe50a6b-2228-43d7-be82-df26fcab6088'} Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:30.614387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.617805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.620557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Returning 404 to user: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:30.620557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c7bb8a67-0da6-4eb6-9e8f-e796cc849da7 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 404 len: 111 microversion: 2.1 time: 0.125086 Jul 26 15:06:30.620557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 114/233] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:30 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:06:30.624900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.625496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.626324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.626968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.751740 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:30.755098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:30.765259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.766180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.768748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.769625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.791646 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:30.796132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] HTTP exception thrown: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.802140 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a44c2dbb-49cc-4643-8063-40b7010cde8a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.199101 Jul 26 15:06:30.802992 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 120/234] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:30 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Request method failure captured: Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088/os-volume_attachments HTTP/1.1 Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKg1Cofzw0Z1oPIdL62YhViPHFWM68vQjw71xjG-ciHvYxXPqAhbhlXgg2ed8HujkYcXAQnvG_cQ_bIAnmxPNt8mCnTmFoKHj9Lz_NCyzI4fOyQ_XmDy88i6Gl7SDdQeCJWj4moYmq8u1ePnC0NRiiwJVuVZYfchBAVrSpZll1wo3o Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:30.806360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: c15d08b7eb014af3afc4d0a6e032f740 Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.807634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'server_id': '7fe50a6b-2228-43d7-be82-df26fcab6088'} Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:30.808390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:30.813113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:30.814258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Returning 404 to user: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:30.814258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-20e2148a-595d-4bd7-b3f7-181da846f700 tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061570 Jul 26 15:06:30.814258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 115/235] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:06:30 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:06:30.820012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-5b4e6903-d9d2-4f34-ad60-e71d3f94939e req-bc11765d-1cac-4a2e-941a-d00e284e8c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42741a2-6bd8-4b11-a61e-e62197667982", "tag": "768f9b46-f40c-462a-9939-66ae8d5ae829"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:30.836399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5b4e6903-d9d2-4f34-ad60-e71d3f94939e req-bc11765d-1cac-4a2e-941a-d00e284e8c19 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:30.836842 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5b4e6903-d9d2-4f34-ad60-e71d3f94939e req-bc11765d-1cac-4a2e-941a-d00e284e8c19 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:30.851124 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-5b4e6903-d9d2-4f34-ad60-e71d3f94939e req-bc11765d-1cac-4a2e-941a-d00e284e8c19 service nova] Creating event network-changed:768f9b46-f40c-462a-9939-66ae8d5ae829 for instance a42741a2-6bd8-4b11-a61e-e62197667982 on hv-cinder-85066 Jul 26 15:06:30.858809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-5b4e6903-d9d2-4f34-ad60-e71d3f94939e req-bc11765d-1cac-4a2e-941a-d00e284e8c19 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053396 Jul 26 15:06:30.860597 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 121/236] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:31.639572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:31.640233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:31.651766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:31.652807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:31.654320 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:31.655631 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:31.825719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:31.826539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:31.833002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:31.833450 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:31.835008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:31.835220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:32.009885 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:32.018569 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-03069f46-7d59-46c1-a19c-a5fcc2778b57 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.197054 Jul 26 15:06:32.019395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 122/237] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:31 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:32.170836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:32.179862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-479ce9d8-26f8-4c12-9493-c7395fae2117 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.548887 Jul 26 15:06:32.180457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 116/238] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:31 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:32.452759 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:32.453260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:32.455348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:32.460544 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:32.460988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:32.461756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:32.462184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:32.477156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] HTTP exception thrown: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Request method failure captured: Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 HTTP/1.1 Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKg1Cofzw0Z1oPIdL62YhViPHFWM68vQjw71xjG-ciHvYxXPqAhbhlXgg2ed8HujkYcXAQnvG_cQ_bIAnmxPNt8mCnTmFoKHj9Lz_NCyzI4fOyQ_XmDy88i6Gl7SDdQeCJWj4moYmq8u1ePnC0NRiiwJVuVZYfchBAVrSpZll1wo3o Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:06:32.481988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: c15d08b7eb014af3afc4d0a6e032f740 Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.483582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '7fe50a6b-2228-43d7-be82-df26fcab6088'} Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:32.484354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.485553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.486856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Returning 404 to user: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:32.486856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c99b37e3-43dd-4e89-89c6-2381386135de tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "DELETE /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 404 len: 111 microversion: 2.1 time: 0.040231 Jul 26 15:06:32.486856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 123/239] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:06:32 2022] DELETE /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:06:32.494932 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:32.495581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] [instance: 7fe50a6b-2228-43d7-be82-df26fcab6088] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:32.502572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:32.503012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:32.503924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:32.504374 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:32.520223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] HTTP exception thrown: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Request method failure captured: Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 HTTP/1.1 Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKg1Cofzw0Z1oPIdL62YhViPHFWM68vQjw71xjG-ciHvYxXPqAhbhlXgg2ed8HujkYcXAQnvG_cQ_bIAnmxPNt8mCnTmFoKHj9Lz_NCyzI4fOyQ_XmDy88i6Gl7SDdQeCJWj4moYmq8u1ePnC0NRiiwJVuVZYfchBAVrSpZll1wo3o Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:32.521762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/bb18a5955f814887bcfa9650bcaa2ce9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: bb18a5955f814887bcfa9650bcaa2ce9 Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-DeleteServersTestJSON-542845351 Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: c15d08b7eb014af3afc4d0a6e032f740 Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-DeleteServersTestJSON-542845351-project Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.523014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '7fe50a6b-2228-43d7-be82-df26fcab6088'} Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:32.523811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. Jul 26 15:06:32.525045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:32.526078 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] Returning 404 to user: Instance 7fe50a6b-2228-43d7-be82-df26fcab6088 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:32.526078 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2784ed9e-44f6-4fac-aae2-32dd9b05563d tempest-DeleteServersTestJSON-542845351 tempest-DeleteServersTestJSON-542845351-project] 10.222.0.94 "GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088" status: 404 len: 111 microversion: 2.1 time: 0.034055 Jul 26 15:06:32.526078 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 117/240] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:32 2022] GET /compute/v2.1/servers/7fe50a6b-2228-43d7-be82-df26fcab6088 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:06:33.041873 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:33.042506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:33.049217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:33.049659 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:33.050440 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:33.050877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:33.224073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:33.230560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:33.237382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:33.253527 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:33.254915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:33.257790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:33.258697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:33.293682 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:33.307568 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-75ca901e-fc9b-41f3-af69-b157f63e26fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.269658 Jul 26 15:06:33.308288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 124/241] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:33 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:33.529670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:33.542765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f155cd14-a52f-4ec4-9fb7-7f55aca67485 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.325918 Jul 26 15:06:33.543620 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 118/242] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:33 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:34.330166 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:34.330811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:34.332739 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:34.338207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:34.338697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:34.339513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:34.339955 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:34.506361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:34.514507 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7b10eb5d-4f8c-4234-aa0c-10c8a6b85f5a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.188432 Jul 26 15:06:34.529865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 125/243] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:34 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:34.570365 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:34.572162 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:34.580116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:34.581038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:34.582674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:34.583416 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:34.650783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=8 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:34.774171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:34.796859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a0e1aa1e-93e6-434a-ad60-dc3434bbde17 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.228513 Jul 26 15:06:34.800340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 119/244] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:34 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:35.543681 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:35.545057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:35.552205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:35.552946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:35.554231 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:35.554901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:35.826645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:35.828070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:35.835571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:35.836180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:35.836956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:35.837392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:35.987973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:36.011180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0fa91802-f9f5-4513-a65f-a0e55be3ed1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.471909 Jul 26 15:06:36.012335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 126/245] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:35 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:36.070215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:36.080421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1444a861-9bb4-4b70-95d8-da7179e0dee2 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.258227 Jul 26 15:06:36.080957 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 120/246] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:35 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:37.033812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:37.034746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:37.051114 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.053935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.057561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.058819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.105063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:37.106791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:37.118007 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.119387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.120708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.121332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.356799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:37.366448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-754010fc-e07d-44bd-9afe-8bfb23589d66 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.266728 Jul 26 15:06:37.367200 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 121/247] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:37 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:37.394699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:37.402619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a5698881-1511-43f2-af12-f99928966b9d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.372710 Jul 26 15:06:37.403315 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 127/248] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:37 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:37.683725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-4f2f9744-a241-46b3-b4d0-74e5bbb480fb req-4a9c1ba7-94d0-4c10-b514-05267ce7665b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42741a2-6bd8-4b11-a61e-e62197667982", "name": "network-vif-plugged", "status": "completed", "tag": "768f9b46-f40c-462a-9939-66ae8d5ae829"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:37.698849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-4f2f9744-a241-46b3-b4d0-74e5bbb480fb req-4a9c1ba7-94d0-4c10-b514-05267ce7665b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.699293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-4f2f9744-a241-46b3-b4d0-74e5bbb480fb req-4a9c1ba7-94d0-4c10-b514-05267ce7665b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.712454 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-4f2f9744-a241-46b3-b4d0-74e5bbb480fb req-4a9c1ba7-94d0-4c10-b514-05267ce7665b service nova] Creating event network-vif-plugged:768f9b46-f40c-462a-9939-66ae8d5ae829 for instance a42741a2-6bd8-4b11-a61e-e62197667982 on hv-cinder-85066 Jul 26 15:06:37.718054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-4f2f9744-a241-46b3-b4d0-74e5bbb480fb req-4a9c1ba7-94d0-4c10-b514-05267ce7665b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040372 Jul 26 15:06:37.719345 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 122/249] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:38.389338 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:38.390343 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:38.397230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:38.398026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:38.398688 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:38.399128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:38.433665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:38.434731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:38.445366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:38.446584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:38.448008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:38.448698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:38.595834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:38.604135 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2c284c4a-4a9e-44aa-9a9b-5152fadd29bf tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.218619 Jul 26 15:06:38.604779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 128/250] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:38 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:38.647707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:38.655957 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a99339bb-40e1-44ad-b13d-1e82a790ef99 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.234424 Jul 26 15:06:38.656704 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 123/251] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:38 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:39.626136 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:39.626854 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:39.633324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:39.633773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:39.634620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:39.635055 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:39.677303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:39.678753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:39.688414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:39.689129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:39.690108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:39.690566 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:39.870484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:39.880927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6a368f8b-bfad-4340-a508-6c8624de9ca3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.207293 Jul 26 15:06:39.883678 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 124/252] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:39 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:39.902189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:39.913319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b4c95885-a8cc-458d-914e-039ab56ad011 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1314 microversion: 2.1 time: 0.291623 Jul 26 15:06:39.914527 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 129/253] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:39 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:40.902883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:40.903565 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:40.910026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:40.910520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:40.911232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:40.911716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:40.934779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:40.936119 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:40.942867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:40.943866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:40.944940 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:40.945475 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:41.100815 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:41.113079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ed59f298-7b65-485f-b311-840e5662e9fe tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.214065 Jul 26 15:06:41.114183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 125/254] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:40 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:41.307434 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:41.316626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d418bf2a-0636-42d3-b717-02e06b3568eb tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1499 microversion: 2.1 time: 0.385829 Jul 26 15:06:41.317598 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 130/255] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:40 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1499 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:42.136562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:42.137168 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:42.143926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:42.144328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:42.145079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:42.145512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:42.305500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:42.313233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ea470d9c-7c80-4bd4-ac28-8b878bc5da1a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.180423 Jul 26 15:06:42.313813 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 126/256] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:42 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:43.337112 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:43.337922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:43.345967 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:43.346547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:43.347450 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:43.348038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:43.489818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:43.498914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-39d60ea0-122e-4542-987e-6ba2584e5c34 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.168291 Jul 26 15:06:43.499599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 131/257] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:43 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:43.591244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:43.591966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:43.598737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:43.599190 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:43.600177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:43.600619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:43.632897 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:06:43.762466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a4f45f73-452b-4920-887a-3abef7cc9e21 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f453735e4c0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:43.824386 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a4f45f73-452b-4920-887a-3abef7cc9e21 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/3391e6b2-3cd2-478b-b604-eb543b3e10b0" status: 200 len: 351 microversion: 2.1 time: 0.066136 Jul 26 15:06:43.825178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 132/258] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:06:43 2022] GET /compute/v2.1/os-volumes/3391e6b2-3cd2-478b-b604-eb543b3e10b0 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:44.198558 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-12a84320-8081-4f33-b093-3ebb6f4dd434 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 204 len: 0 microversion: 2.1 time: 0.611400 Jul 26 15:06:44.207931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 127/259] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:06:43 2022] DELETE /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:06:44.213808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:44.214627 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:44.223794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.225373 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.226481 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.227191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.409408 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:44.414865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:44.419708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-382eaae6-abdb-4bcd-9201-3e2723c7e6b5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1505 microversion: 2.1 time: 0.211887 Jul 26 15:06:44.420374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 133/260] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:44 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:44.522576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:44.523414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:44.530547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.530679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.531353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.531808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.679394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:44.689104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-72288b9c-9dfb-411d-8a42-c1193be79dc5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.171685 Jul 26 15:06:44.690033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 128/261] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:44 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:45.441705 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:45.448603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:45.450813 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.451262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.452129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.453733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.632175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:45.640278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-24fdcae6-5cb4-449d-b04e-c5187bbe279a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1505 microversion: 2.1 time: 0.202443 Jul 26 15:06:45.640852 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 134/262] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:45 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:45.712680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:45.713958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:45.722418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.722914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.723886 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.724474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.814838 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c26b264e-3e5d-41cb-ab81-8e9efb0be178 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4537367430>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:45.875789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c26b264e-3e5d-41cb-ab81-8e9efb0be178 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/8f704266-0896-4666-9c7a-3ab85726740f" status: 200 len: 350 microversion: 2.1 time: 0.064340 Jul 26 15:06:45.878249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 135/263] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:06:45 2022] GET /compute/v2.1/os-volumes/8f704266-0896-4666-9c7a-3ab85726740f => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:06:45.891989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:45.916995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d9bb8c3a-e040-481a-b141-e4b1c822c320 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.197317 Jul 26 15:06:45.916995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 129/264] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:45 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:46.676261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:46.679118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:46.690029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:46.690029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:46.690632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:46.691081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:46.937790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:46.939036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:46.947374 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:46.948138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:46.949724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:46.950329 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:46.978912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:46.994400 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:47.006730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-01d9f164-7a88-4441-b5cd-594348694e3c tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1505 microversion: 2.1 time: 0.346141 Jul 26 15:06:47.008079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 136/265] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:46 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:47.198758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:47.226894 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bead7bcf-781a-4a05-98c7-77ab8b571767 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.293824 Jul 26 15:06:47.232272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 130/266] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:46 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:47.638911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-ce911d1a-569f-4a07-ae3c-ee182e4c1934 req-149d1f91-2fdd-4cce-84b3-4ada6a31c9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42741a2-6bd8-4b11-a61e-e62197667982", "name": "network-vif-deleted", "tag": "768f9b46-f40c-462a-9939-66ae8d5ae829"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:47.657257 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-ce911d1a-569f-4a07-ae3c-ee182e4c1934 req-149d1f91-2fdd-4cce-84b3-4ada6a31c9e8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:47.658156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-ce911d1a-569f-4a07-ae3c-ee182e4c1934 req-149d1f91-2fdd-4cce-84b3-4ada6a31c9e8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:47.679052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-ce911d1a-569f-4a07-ae3c-ee182e4c1934 req-149d1f91-2fdd-4cce-84b3-4ada6a31c9e8 service nova] Creating event network-vif-deleted:768f9b46-f40c-462a-9939-66ae8d5ae829 for instance a42741a2-6bd8-4b11-a61e-e62197667982 on hv-cinder-85066 Jul 26 15:06:47.685932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-ce911d1a-569f-4a07-ae3c-ee182e4c1934 req-149d1f91-2fdd-4cce-84b3-4ada6a31c9e8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053597 Jul 26 15:06:47.691707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 137/267] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:47.757593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fb8e82b8-80e7-43e6-ac0c-68ed01931944 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532b88c10>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:47.821306 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fb8e82b8-80e7-43e6-ac0c-68ed01931944 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/29e213c4-9132-4cf3-8d06-29cd204e7734" status: 200 len: 351 microversion: 2.1 time: 0.066410 Jul 26 15:06:47.835050 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4dd9c6f5-b22e-417f-aab2-fbe393ccbf52 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4537367ca0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:47.835456 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 131/268] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:06:47 2022] GET /compute/v2.1/os-volumes/29e213c4-9132-4cf3-8d06-29cd204e7734 => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:47.942649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4dd9c6f5-b22e-417f-aab2-fbe393ccbf52 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.108215 Jul 26 15:06:47.942649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 138/269] 10.222.0.94 () {58 vars in 1134 bytes} [Tue Jul 26 15:06:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:47.956814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a817cfd8-1f7c-4373-ba5a-46a5d1bbf5fa tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532bf7040>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.031362 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.032280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:48.040803 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.041252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.042045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.042836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.047075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a817cfd8-1f7c-4373-ba5a-46a5d1bbf5fa tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095214 Jul 26 15:06:48.047807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 132/270] 10.222.0.94 () {58 vars in 1149 bytes} [Tue Jul 26 15:06:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:48.062696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-af97a655-1e26-4636-911d-0101eb754774 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532bab0d0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.161180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-af97a655-1e26-4636-911d-0101eb754774 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.097608 Jul 26 15:06:48.166345 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 133/271] 10.222.0.94 () {58 vars in 1134 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:48.172576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fa1a5ef7-410a-41b7-8411-6c41eb2d4f11 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532bd69d0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.174962 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.189206 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9e3d67b7-e42d-48d2-8c3a-120886b60b73 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1463 microversion: 2.1 time: 0.161098 Jul 26 15:06:48.190621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 139/272] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:48.260875 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.265592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:48.283170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.283677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.286564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.289770 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.307330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fa1a5ef7-410a-41b7-8411-6c41eb2d4f11 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.139511 Jul 26 15:06:48.309531 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 134/273] 10.222.0.94 () {58 vars in 1167 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:48.343889 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9bc67b5b-3b1b-46c8-bf26-597c2c68fe8c tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532bf50d0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.460851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9bc67b5b-3b1b-46c8-bf26-597c2c68fe8c tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138939 Jul 26 15:06:48.461977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 135/274] 10.222.0.94 () {58 vars in 1170 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:48.478330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3b05b15b-23f0-45bb-ae81-a7ef9220b9d2 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532bbd700>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.560789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.576536 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e6851d2d-7232-414f-b802-daec06766ce7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.321194 Jul 26 15:06:48.587510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 140/275] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:48.659769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3b05b15b-23f0-45bb-ae81-a7ef9220b9d2 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.186900 Jul 26 15:06:48.660578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 136/276] 10.222.0.94 () {58 vars in 1155 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:48.679508 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3ee45c54-7592-450b-b9dc-1f526af62b46 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f453735ef70>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.798123 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3ee45c54-7592-450b-b9dc-1f526af62b46 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.127414 Jul 26 15:06:48.799174 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 141/277] 10.222.0.94 () {58 vars in 1188 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:48.816729 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-248ad8e1-c7c8-4ac2-bb77-2d7f3f5116d9 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] Calling method '.version_select at 0x7f4532bf5670>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.912261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-248ad8e1-c7c8-4ac2-bb77-2d7f3f5116d9 tempest-VolumesTestJSON-1160501939 tempest-VolumesTestJSON-1160501939-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099694 Jul 26 15:06:48.912827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 137/278] 10.222.0.94 () {58 vars in 1155 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:49.218222 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:49.218835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:49.242004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.243722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.244559 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.245004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.282161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.282884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.283327 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lazy-loading 'fault' on Instance uuid a42741a2-6bd8-4b11-a61e-e62197667982 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:06:49.326825 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:49.335265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8b917b61-9b4f-43ab-b2f1-91cdbe168082 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1304 microversion: 2.1 time: 0.120810 Jul 26 15:06:49.335933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 142/279] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:49 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:49.612243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:49.613035 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:49.621776 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.622221 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.624223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.624223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.786541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:49.799085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-094c7a0e-ea0a-401e-a236-6aaaa185798b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1522 microversion: 2.1 time: 0.191485 Jul 26 15:06:49.800138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 138/280] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:49 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:49.982921 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1246233016", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "networks": [{"uuid": "d851ed92-9c90-461b-be87-9a00db72d9c3"}]}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:50.044621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] validate_networks() for [('d851ed92-9c90-461b-be87-9a00db72d9c3', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:06:50.373783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:50.374486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:50.383112 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.383751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.384603 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.385222 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.442149 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.442976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.444805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lazy-loading 'fault' on Instance uuid a42741a2-6bd8-4b11-a61e-e62197667982 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:06:50.476296 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:06:50.476763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:06:50.477252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:06:50.477661 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:06:50.478090 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:06:50.487339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.487738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.488532 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.488958 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.498633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.507303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-885a5fce-be01-4ffb-947c-cb7aefc90200 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 200 len: 1304 microversion: 2.1 time: 0.138090 Jul 26 15:06:50.508697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 139/281] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:50 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:50.510155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Getting quotas for project 87391d9e4bdc48209437f1d786f376c1. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:06:50.516516 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Getting quotas for user 9cb5ce208a2442c2b9b39ac92da6a78e and project 87391d9e4bdc48209437f1d786f376c1. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:06:50.529076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:06:50.531337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:06:50.765045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d4d4391d-cc04-4f61-914a-83f06e76fa96 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785905 Jul 26 15:06:50.765823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 143/282] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:06:50.777439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-968945ca-5d3d-4e5f-9eb8-693c1dca2598 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:50.778047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-968945ca-5d3d-4e5f-9eb8-693c1dca2598 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:50.821632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:50.822239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:50.829715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.830158 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.832227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.832836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.850107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-968945ca-5d3d-4e5f-9eb8-693c1dca2598 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.858592 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-968945ca-5d3d-4e5f-9eb8-693c1dca2598 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1219 microversion: 2.1 time: 0.084873 Jul 26 15:06:50.859262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 140/283] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:50 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:51.012357 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.020308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ac2b8803-b714-4ecd-b7b2-02ad8541cda8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1502 microversion: 2.1 time: 0.203101 Jul 26 15:06:51.020877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 144/284] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:50 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:51.042170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:51.042779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:51.049444 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.049937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.050764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.051234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.204753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.213152 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6f26116a-40be-4e80-af26-5aa4568cd350 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1516 microversion: 2.1 time: 0.174813 Jul 26 15:06:51.213726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 141/285] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:51 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:51.529415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:51.530309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: a42741a2-6bd8-4b11-a61e-e62197667982] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:51.536917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.537371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.538313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.538752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.555072 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] HTTP exception thrown: Instance a42741a2-6bd8-4b11-a61e-e62197667982 could not be found. Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Request method failure captured: Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 HTTP/1.1 Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ALrt1MdbfP90Vr_fwpR8HHhoN9CNfupbv5Tuhx4S7nafKh4ZHXrNr2z-2BYgvZVN2DJRh6mZVTud2seEy-aWKMzynAXlq_-q97X2mD711GjtLM_NGLPSAm7GmToU8fpMQvgn59UlqSAsvJKf6F9d2hHFvpjpR87DdRqhK29l7uFf0Q Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 4272758d01274f419bc75c85140daa06 Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-VolumesActionsTest-151571423 Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:06:51.556848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_4272758d01274f419bc75c85140daa06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/4272758d01274f419bc75c85140daa06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4272758d01274f419bc75c85140daa06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4272758d01274f419bc75c85140daa06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-VolumesActionsTest-151571423 Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 4272758d01274f419bc75c85140daa06 Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-VolumesActionsTest-151571423 Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-VolumesActionsTest-151571423-project Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 2bf28a5c061c42668fc54a0c50af64ee Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-VolumesActionsTest-151571423-project Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance a42741a2-6bd8-4b11-a61e-e62197667982 could not be found. Jul 26 15:06:51.558313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'a42741a2-6bd8-4b11-a61e-e62197667982'} Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42741a2-6bd8-4b11-a61e-e62197667982 could not be found. Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:51.559180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42741a2-6bd8-4b11-a61e-e62197667982 could not be found. Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42741a2-6bd8-4b11-a61e-e62197667982 could not be found. Jul 26 15:06:51.560663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:51.561798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Returning 404 to user: Instance a42741a2-6bd8-4b11-a61e-e62197667982 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:51.561798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-05d62c2b-c87b-4ea0-b32a-da829e64a734 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982" status: 404 len: 111 microversion: 2.1 time: 0.033231 Jul 26 15:06:51.561798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 145/286] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:51 2022] GET /compute/v2.1/servers/a42741a2-6bd8-4b11-a61e-e62197667982 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:06:51.680040 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1479462425", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "networks": [{"uuid": "f592bdd4-ff36-4285-b3a5-96166a7a017a"}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:51.745198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] validate_networks() for [('f592bdd4-ff36-4285-b3a5-96166a7a017a', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:06:51.886584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7ae5e8e9-96bb-4a16-83b0-000d9e99f3f7 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:51.887485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7ae5e8e9-96bb-4a16-83b0-000d9e99f3f7 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:51.957557 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7ae5e8e9-96bb-4a16-83b0-000d9e99f3f7 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.965847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7ae5e8e9-96bb-4a16-83b0-000d9e99f3f7 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1219 microversion: 2.1 time: 0.086735 Jul 26 15:06:51.979995 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 146/287] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:51 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:52.259494 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:06:52.260383 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:06:52.260552 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:06:52.261717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:06:52.262252 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:06:52.293070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.293070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:52.293070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.293070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:52.310105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Getting quotas for project 4272758d01274f419bc75c85140daa06. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:06:52.314632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Getting quotas for user 2bf28a5c061c42668fc54a0c50af64ee and project 4272758d01274f419bc75c85140daa06. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:06:52.332815 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:06:52.335654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:06:52.347237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:52.447680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6ef05970-9e3d-4a1a-8838-08eb4157c145 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772826 Jul 26 15:06:52.448413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 142/288] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:06:52.460775 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-16540df0-7d2c-4589-ad77-bf73a4de2c91 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:52.461394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-16540df0-7d2c-4589-ad77-bf73a4de2c91 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:52.542803 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-16540df0-7d2c-4589-ad77-bf73a4de2c91 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:52.550539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-16540df0-7d2c-4589-ad77-bf73a4de2c91 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1214 microversion: 2.1 time: 0.094806 Jul 26 15:06:52.551408 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 147/289] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:52 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:52.989364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:52.990025 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:52.999046 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.999556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.000314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.001034 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.077947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:53.088675 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-99224903-fb5b-4fab-84fe-36a0b62ba25a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1271 microversion: 2.1 time: 0.103600 Jul 26 15:06:53.089409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 143/290] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:52 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:53.105281 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:53.107813 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:53.113933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.114376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.115674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.116112 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.140187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'flavor' on Instance uuid ebca4e54-4a78-49e4-b381-6cd1203b3535 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:06:53.578183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:53.579027 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:53.587295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.587730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.588523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.588971 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.596548 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e3010186-1db9-4935-a365-5b0c4e7f0d71 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/action" status: 200 len: 32 microversion: 2.1 time: 0.495177 Jul 26 15:06:53.597137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 148/291] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:06:53 2022] POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/action => generated 32 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:06:53.608926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:53.609763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:53.620118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.620771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.621982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.622466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.659933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:53.668766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-265e5dab-b391-446e-ba17-cd31ca8e55fd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1218 microversion: 2.1 time: 0.094510 Jul 26 15:06:53.669359 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 144/292] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:53 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:53.772337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:53.780278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d69ee067-2f19-4423-b326-9a29fec4b134 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.176407 Jul 26 15:06:53.780849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 149/293] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:53 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:54.116122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:54.116836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:54.124170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.124538 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.125411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.125746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.202068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.211386 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1744d99f-0fa5-4ec1-a955-b0a12c3ee7a0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1271 microversion: 2.1 time: 0.099711 Jul 26 15:06:54.212025 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 145/294] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:54 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:54.690943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:54.691696 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:54.699522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.699976 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.700757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.701191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.774285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.782053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-dde69742-7d76-40e5-87e4-7636642f67a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1218 microversion: 2.1 time: 0.095482 Jul 26 15:06:54.782791 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 150/295] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:54 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:54.801563 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:54.802743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:54.809243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.809655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.810429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.810867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.959610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.974718 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b38fc541-c709-4d37-b1de-22ff59e7c64b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.176353 Jul 26 15:06:54.976101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 146/296] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:54 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:55.233002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:55.234235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:55.241651 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.242195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.243056 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.243738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.314876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.324952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2d7f39cc-457a-4267-9dbc-d75482fed74f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1271 microversion: 2.1 time: 0.096250 Jul 26 15:06:55.325776 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 151/297] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:55 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:55.803651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:55.803651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:55.811117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.811728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.813042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.813800 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.908652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.919146 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-70068c23-1ebc-4d0c-af18-fc7db49c6ddc tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1218 microversion: 2.1 time: 0.120548 Jul 26 15:06:55.920154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 147/298] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:55 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:56.007729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.009026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:56.015459 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.016086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.016948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.017603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.200810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.219585 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c4e1b797-fdf6-44b2-a574-5a44d15361d3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.215955 Jul 26 15:06:56.221686 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 152/299] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:56 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:56.348340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.349041 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:56.358167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.359095 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.362861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.369820 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.422578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a30cc893-0a3f-4f1f-9f7c-f9689c4a3590 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Action: 'create', calling method: .version_select at 0x7f4532b445e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-700424784", "metadata": {"Type": "work"}}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:56.491039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.499741 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b6f2b8a3-d06c-49f4-bad2-fd162de1b920 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1279 microversion: 2.1 time: 0.155261 Jul 26 15:06:56.500666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 153/300] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:56 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a30cc893-0a3f-4f1f-9f7c-f9689c4a3590 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Request method failure captured: Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 121 Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AMQYZTX-4Ru_P0NlZH6swZVCTT7Suf_RiopjqjzkKdLV-NDBYSCIkGolc2xuVd-CX5QwOgay3eRRx2G-0u2tQPtjLOwwNA0g8ozv0V7u18HxQYRGjiz7CHUFPbYcnQSwcxM-frkXxjbt2QP68906_3ycXM5e6zCfugQO0AILNN2FSo Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:56.908662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 135998a9e33646d4aeb8824547291056 Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-700424784", "metadata": {"Type": "work"}}} Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:06:56.910460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-700424784', 'metadata': {'Type': 'work'}}}} Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:56.911274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:06:56.912773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:06:56.913922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:06:56.913922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.913922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a30cc893-0a3f-4f1f-9f7c-f9689c4a3590 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:56.913922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a30cc893-0a3f-4f1f-9f7c-f9689c4a3590 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.707019 Jul 26 15:06:56.913922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 148/301] 10.222.0.94 () {60 vars in 1156 bytes} [Tue Jul 26 15:06:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 708 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 15:06:56.920469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ced41376-d12b-4291-9eef-900af901c28b tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Action: 'create', calling method: .version_select at 0x7f4537645dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1194979164", "metadata": {"Type": "work"}}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ced41376-d12b-4291-9eef-900af901c28b tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Request method failure captured: Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 120 Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AMQYZTX-4Ru_P0NlZH6swZVCTT7Suf_RiopjqjzkKdLV-NDBYSCIkGolc2xuVd-CX5QwOgay3eRRx2G-0u2tQPtjLOwwNA0g8ozv0V7u18HxQYRGjiz7CHUFPbYcnQSwcxM-frkXxjbt2QP68906_3ycXM5e6zCfugQO0AILNN2FSo Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:06:56.927742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 135998a9e33646d4aeb8824547291056 Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1194979164", "metadata": {"Type": "work"}}} Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: Jul 26 15:06:56.929763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1194979164', 'metadata': {'Type': 'work'}}}} Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi '0' Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:56.930558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:06:56.931982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:06:56.933057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:06:56.933057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.933057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ced41376-d12b-4291-9eef-900af901c28b tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:56.933057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ced41376-d12b-4291-9eef-900af901c28b tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012682 Jul 26 15:06:56.933057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 154/302] 10.222.0.94 () {60 vars in 1156 bytes} [Tue Jul 26 15:06:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:06:56.941918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4b42063c-0f6b-4d58-ae0f-74a6080b3dea tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Action: 'create', calling method: .version_select at 0x7f4532bd6dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1924700233", "metadata": {"Type": "work"}}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4b42063c-0f6b-4d58-ae0f-74a6080b3dea tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Request method failure captured: Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 119 Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AMQYZTX-4Ru_P0NlZH6swZVCTT7Suf_RiopjqjzkKdLV-NDBYSCIkGolc2xuVd-CX5QwOgay3eRRx2G-0u2tQPtjLOwwNA0g8ozv0V7u18HxQYRGjiz7CHUFPbYcnQSwcxM-frkXxjbt2QP68906_3ycXM5e6zCfugQO0AILNN2FSo Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:56.947752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 135998a9e33646d4aeb8824547291056 Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1924700233", "metadata": {"Type": "work"}}} Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:06:56.949417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1924700233', 'metadata': {'Type': 'work'}}}} Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi '' Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:56.950478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:06:56.952177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:06:56.953654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:06:56.953654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:56.953654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4b42063c-0f6b-4d58-ae0f-74a6080b3dea tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:56.953988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.954089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4b42063c-0f6b-4d58-ae0f-74a6080b3dea tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013240 Jul 26 15:06:56.954162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:56.954247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 149/303] 10.222.0.94 () {60 vars in 1156 bytes} [Tue Jul 26 15:06:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:06:56.961480 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.962054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.963085 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.963212 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-982519d7-e271-45ff-9a48-953d93053a11 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Calling method '.version_select at 0x7f4532d91c10>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.963687 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-982519d7-e271-45ff-9a48-953d93053a11 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] HTTP exception thrown: Volume tempest-invalid-1159059867 could not be found. Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-982519d7-e271-45ff-9a48-953d93053a11 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Request method failure captured: Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1159059867 HTTP/1.1 Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AMQYZTX-4Ru_P0NlZH6swZVCTT7Suf_RiopjqjzkKdLV-NDBYSCIkGolc2xuVd-CX5QwOgay3eRRx2G-0u2tQPtjLOwwNA0g8ozv0V7u18HxQYRGjiz7CHUFPbYcnQSwcxM-frkXxjbt2QP68906_3ycXM5e6zCfugQO0AILNN2FSo Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:57.113026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 135998a9e33646d4aeb8824547291056 Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Volume tempest-invalid-1159059867 could not be found. Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'tempest-invalid-1159059867'} Jul 26 15:06:57.114210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1159059867 could not be found. (HTTP 404) (Request-ID: req-69cf9e2d-0e1f-4465-ab04-07cae3d7a95e) Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.115834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:06:57.116981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1159059867 could not be found. Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:57.118094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1159059867 could not be found. Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1159059867 could not be found. Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-982519d7-e271-45ff-9a48-953d93053a11 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Returning 404 to user: Volume tempest-invalid-1159059867 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-982519d7-e271-45ff-9a48-953d93053a11 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1159059867" status: 404 len: 99 microversion: 2.1 time: 0.038642 Jul 26 15:06:57.119645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 150/304] 10.222.0.94 () {58 vars in 1218 bytes} [Tue Jul 26 15:06:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1159059867 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 15:06:57.120547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.120547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-113c3fd3-2d8b-4b98-9c35-946f31da05af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1210 microversion: 2.1 time: 0.098155 Jul 26 15:06:57.120547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 155/305] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:56 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:57.123072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1d9d105d-3e39-4c3c-a594-693068d778fd tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004070 Jul 26 15:06:57.124042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 151/306] 10.222.0.94 () {58 vars in 1140 bytes} [Tue Jul 26 15:06:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 15:06:57.133601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b505003c-b897-48a2-a455-083ed119b325 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004661 Jul 26 15:06:57.134214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 156/307] 10.222.0.94 () {58 vars in 1137 bytes} [Tue Jul 26 15:06:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 15:06:57.144506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f31a22c1-c783-4bbb-8cee-a8fa600e3f00 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Calling method '.version_select at 0x7f4532bd6b80>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:57.211885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-f31a22c1-c783-4bbb-8cee-a8fa600e3f00 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] HTTP exception thrown: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f31a22c1-c783-4bbb-8cee-a8fa600e3f00 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Request method failure captured: Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: DELETE /compute/v2.1/os-volumes/7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 HTTP/1.1 Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AMQYZTX-4Ru_P0NlZH6swZVCTT7Suf_RiopjqjzkKdLV-NDBYSCIkGolc2xuVd-CX5QwOgay3eRRx2G-0u2tQPtjLOwwNA0g8ozv0V7u18HxQYRGjiz7CHUFPbYcnQSwcxM-frkXxjbt2QP68906_3ycXM5e6zCfugQO0AILNN2FSo Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:06:57.213898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 135998a9e33646d4aeb8824547291056 Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63'} Jul 26 15:06:57.215151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. (HTTP 404) (Request-ID: req-97f36e4d-5236-4f5d-abe4-02fdf4a52f5f) Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.215906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:06:57.217079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:06:57.218083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. Jul 26 15:06:57.219060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.220558 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f31a22c1-c783-4bbb-8cee-a8fa600e3f00 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Returning 404 to user: Volume 7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:57.221439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f31a22c1-c783-4bbb-8cee-a8fa600e3f00 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63" status: 404 len: 109 microversion: 2.1 time: 0.081812 Jul 26 15:06:57.221995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 152/308] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:06:57 2022] DELETE /compute/v2.1/os-volumes/7f042ec9-6ef0-42be-ac00-ccd1b3ca2e63 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:06:57.244546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d79cc7ad-5b7c-4b2c-a436-be53cae81061 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Calling method '.version_select at 0x7f45375d8d30>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:57.245041 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:57.245668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:57.262653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.263277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.264326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.264768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.286156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-d79cc7ad-5b7c-4b2c-a436-be53cae81061 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] HTTP exception thrown: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d79cc7ad-5b7c-4b2c-a436-be53cae81061 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Request method failure captured: Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/os-volumes/c2c73c6c-639b-459a-aa0b-da64deee8285 HTTP/1.1 Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AMQYZTX-4Ru_P0NlZH6swZVCTT7Suf_RiopjqjzkKdLV-NDBYSCIkGolc2xuVd-CX5QwOgay3eRRx2G-0u2tQPtjLOwwNA0g8ozv0V7u18HxQYRGjiz7CHUFPbYcnQSwcxM-frkXxjbt2QP68906_3ycXM5e6zCfugQO0AILNN2FSo Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:06:57.289300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2995c91727ba49b39d52b8af8ff2407b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 2995c91727ba49b39d52b8af8ff2407b Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-VolumesNegativeTest-1152504192 Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 135998a9e33646d4aeb8824547291056 Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-VolumesNegativeTest-1152504192-project Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'c2c73c6c-639b-459a-aa0b-da64deee8285'} Jul 26 15:06:57.290956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. (HTTP 404) (Request-ID: req-2326742a-f741-4855-9cb6-d2540bcd2ebe) Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.291830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:06:57.292926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:06:57.294065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d79cc7ad-5b7c-4b2c-a436-be53cae81061 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] Returning 404 to user: Volume c2c73c6c-639b-459a-aa0b-da64deee8285 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d79cc7ad-5b7c-4b2c-a436-be53cae81061 tempest-VolumesNegativeTest-1152504192 tempest-VolumesNegativeTest-1152504192-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/c2c73c6c-639b-459a-aa0b-da64deee8285" status: 404 len: 109 microversion: 2.1 time: 0.062493 Jul 26 15:06:57.295370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 157/309] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:06:57 2022] GET /compute/v2.1/os-volumes/c2c73c6c-639b-459a-aa0b-da64deee8285 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:06:57.447342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.455600 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2ba2b7d2-6a7e-499a-b40e-748b737854a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.215014 Jul 26 15:06:57.456359 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 153/310] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:57 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:57.526771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:57.527734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:57.537117 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.537871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.538880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.539525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.569248 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:57.715604 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.724912 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a6d32a4c-7902-4ff7-9555-766d3135fbed tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1277 microversion: 2.1 time: 0.202722 Jul 26 15:06:57.729731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 158/311] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:57 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:58.135518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:58.136186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:58.142472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.142910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.143826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.144413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.231247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.253011 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7252c892-20cb-4dda-b6a1-8bf61ce55be7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1274 microversion: 2.1 time: 0.121626 Jul 26 15:06:58.253764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 154/312] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:58 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:58.478814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:58.479422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:58.487046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.487746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.488618 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.489124 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.652487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.662610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2a52fef7-a4a6-4382-8a94-015a34986e14 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.188353 Jul 26 15:06:58.663486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 159/313] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:58 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:58.748547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:58.749165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:58.756522 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.756966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.762668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.762668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.904261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.913279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8c0eebc0-9bb6-49e6-bf43-d9d8d907de02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.170701 Jul 26 15:06:58.914621 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 155/314] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:58 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:59.274995 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:59.275635 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:59.283351 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.283827 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.284610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.285044 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.349452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:59.357080 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5cde6404-384b-473e-a0f0-324e7160fd6b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1274 microversion: 2.1 time: 0.086117 Jul 26 15:06:59.357627 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 160/315] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:59 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:59.687259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:59.688452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:59.698205 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.698991 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.700204 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.701021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.881784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:59.891162 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2a3758cb-916e-44ce-800d-8bf10d03c417 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.209053 Jul 26 15:06:59.897206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 156/316] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:59 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:59.935169 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:59.936795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:59.945325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.946342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.947384 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.947996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.110384 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.119145 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3e2c696c-d761-4465-8220-34b957070c2c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.188467 Jul 26 15:07:00.120116 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 161/317] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:59 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:00.378298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:00.379003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:00.386517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.386952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.387785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.388216 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.463641 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.475448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c1fc5e13-effa-4168-b1e4-864af3c6b450 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1274 microversion: 2.1 time: 0.100903 Jul 26 15:07:00.476304 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 157/318] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:00 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:00.915128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:00.915817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:00.921567 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:00.931759 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.932520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.933683 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.934185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.146619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:01.147901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:01.154524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.155174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.156210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.156786 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.321872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.339610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-04e1671d-26a3-4144-9e2a-1e67ac22ba7c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.428355 Jul 26 15:07:01.343287 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 162/319] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:00 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:01.497495 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:01.498107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:01.504286 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.504664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.506139 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.506580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.551268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.593003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4c9582fa-4362-4ec1-99ba-2a9869cbf33c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.456982 Jul 26 15:07:01.593904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 158/320] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:01 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:01.631230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.642126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fabef826-2d8c-4ec3-8eb6-ab44be667abd tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1272 microversion: 2.1 time: 0.148492 Jul 26 15:07:01.656684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 163/321] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:01 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:02.063237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-74f68172-d315-45ef-b00a-eda511ec6acc req-205b7fea-9d88-4c29-9c24-b89ee49afe76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a050fd-1d02-47df-b37b-17f496480a78", "tag": "642f8bc5-5d97-4c38-a9b4-6db449ae030e"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:02.074823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-74f68172-d315-45ef-b00a-eda511ec6acc req-205b7fea-9d88-4c29-9c24-b89ee49afe76 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.075405 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-74f68172-d315-45ef-b00a-eda511ec6acc req-205b7fea-9d88-4c29-9c24-b89ee49afe76 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.089633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-74f68172-d315-45ef-b00a-eda511ec6acc req-205b7fea-9d88-4c29-9c24-b89ee49afe76 service nova] Creating event network-changed:642f8bc5-5d97-4c38-a9b4-6db449ae030e for instance 43a050fd-1d02-47df-b37b-17f496480a78 on hv-cinder-85066 Jul 26 15:07:02.095169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-74f68172-d315-45ef-b00a-eda511ec6acc req-205b7fea-9d88-4c29-9c24-b89ee49afe76 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036335 Jul 26 15:07:02.096471 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 159/322] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:02.365736 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:02.367755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:02.376793 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.377289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.379181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.379181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.548610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=10 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:02.587946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.595810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6d972b3a-9d9f-45e8-87f9-5900b63e73cf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.234723 Jul 26 15:07:02.596695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 164/323] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:02 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:02.611727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:02.613197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=8 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:02.619116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:02.619924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:02.626997 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.627704 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.632122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.632122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.666127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:02.666998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:02.673516 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.674201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.675211 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.675826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.869030 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.878459 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-eaae7311-9b7b-419e-afd4-d2a6cb1f4e85 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.267918 Jul 26 15:07:02.893053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 160/324] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:02 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:02.922963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.930841 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-460476e4-6782-4f4f-8403-9a84f87678a5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.269382 Jul 26 15:07:02.931446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 165/325] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:02 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:03.138062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-3b73745c-684a-4233-9499-41c039d4b534 req-104a1dd2-00ec-49d2-adb3-93b3510879a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde", "tag": "8c8dadd9-04ed-4a57-81f8-f4cbde8cee8d"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:03.158881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-3b73745c-684a-4233-9499-41c039d4b534 req-104a1dd2-00ec-49d2-adb3-93b3510879a9 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.159424 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-3b73745c-684a-4233-9499-41c039d4b534 req-104a1dd2-00ec-49d2-adb3-93b3510879a9 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.172847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:03.194078 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-3b73745c-684a-4233-9499-41c039d4b534 req-104a1dd2-00ec-49d2-adb3-93b3510879a9 service nova] Creating event network-changed:8c8dadd9-04ed-4a57-81f8-f4cbde8cee8d for instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde on hv-cinder-85066 Jul 26 15:07:03.198541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-3b73745c-684a-4233-9499-41c039d4b534 req-104a1dd2-00ec-49d2-adb3-93b3510879a9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070880 Jul 26 15:07:03.199505 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 161/326] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:03.619346 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:03.619949 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:03.622361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:03.627629 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.628110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.628970 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.629485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.770048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:03.778422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-510aa685-4be6-4fce-84c4-238a3dd68211 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.164124 Jul 26 15:07:03.779043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 166/327] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:03 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:03.904413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:03.905037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:03.912701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.913137 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.913899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.914326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.965508 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:03.971324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:03.985930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.986857 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.988346 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.989917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:04.090539 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:04.098132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-89ab6746-b923-4c7a-a3db-142af6d9de43 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.198938 Jul 26 15:07:04.107677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 162/328] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:03 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:04.148007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:04.155559 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f2970931-add7-4007-bbae-b0a10dfb9d22 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.205699 Jul 26 15:07:04.165612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 167/329] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:03 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:04.801134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:04.801942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:04.810633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:04.811534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:04.812474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:04.813070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:04.947037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:04.955273 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2d9b30b5-6aa8-412a-925b-352143da44e1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.159528 Jul 26 15:07:04.956192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 163/330] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:04 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:05.119399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:05.120045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:05.126946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.127417 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.128277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.128722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.178435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:05.178951 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:05.186616 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.187219 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.193715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.193715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.284060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:05.293830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a37b599e-726d-4d1b-967f-10ed85eef2f9 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.178286 Jul 26 15:07:05.294420 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 168/331] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:05 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:05.343921 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:05.352836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2bf2da71-b895-4f6c-ab7c-873590c3ff2a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.179458 Jul 26 15:07:05.353467 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 164/332] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:05 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:05.977559 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:05.978254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:05.984721 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.985184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.985972 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.986414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.139221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.147201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fe2cd4a5-947e-4431-b100-36b174bc13d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.173960 Jul 26 15:07:06.147823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 169/333] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:05 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:06.314306 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:06.315081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:06.323577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.324226 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.325166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.325632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.375215 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:06.375936 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:06.382951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.383497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.384280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.384760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.542129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.547635 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.550222 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c4177dcd-0bec-49b9-a0c6-450b4f7694e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.179261 Jul 26 15:07:06.550792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 170/334] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:06 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:06.556624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0d4c31af-5e20-4a22-b2a9-a6925b2cc285 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.245936 Jul 26 15:07:06.557200 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 165/335] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:06 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:07.168839 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:07.169359 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:07.175817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.176757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.178093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.178537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.320731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.328685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-82fddbb6-c24d-44ff-9bfb-277daf55ec82 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.163925 Jul 26 15:07:07.329253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 171/336] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:07 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:07.576972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:07.576972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:07.590912 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:07.592047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:07.597952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.598810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.599834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.600294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.600401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.600884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.601674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.602107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.779611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.791986 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.796393 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5784552b-5e78-4a74-97c5-faae0c5f894b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.224447 Jul 26 15:07:07.798040 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 166/337] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:07 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:07.802040 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2ff39841-9386-41af-8e58-fb9c34475c8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.216006 Jul 26 15:07:07.802613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 172/338] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:07 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:08.351571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:08.352225 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:08.358559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.359001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.359802 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.360227 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.490826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:08.498634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-368fd38e-1372-4759-a002-bf05f4592292 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.151870 Jul 26 15:07:08.499189 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 167/339] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:08 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:08.819052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:08.820528 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:08.823751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:08.824401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:08.826898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.827356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.828164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.828607 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.831076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.831557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.832559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.832905 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.972927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:08.983919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d8dfa148-9dce-45a5-83ae-135e030b4d99 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.169296 Jul 26 15:07:08.984549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 173/340] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:08 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:09.211737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.221187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7b319bdc-240f-4398-bf87-8e7c6ccf4b5a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.402857 Jul 26 15:07:09.221760 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 168/341] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:08 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:09.521162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:09.522115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:09.528548 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.529121 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.529997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.530530 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.677761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.681622 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:09.686566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1c0ee796-7828-4d9e-b2c5-8bb65b9ec0ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.169598 Jul 26 15:07:09.699489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 174/342] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:09 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:10.007218 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:10.008054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:10.014577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.015026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.015875 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.016356 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.159934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:10.167614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f5bd1d8c-d83e-4e3f-a60f-d5ac4a9fcdde tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.165229 Jul 26 15:07:10.168165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 169/343] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:10 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:10.242617 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:10.243232 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:10.249780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.250293 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.251087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.251547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.400916 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:10.409404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-accc9e13-e3ee-4860-a9ba-1579531385b6 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.171162 Jul 26 15:07:10.410184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 175/344] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:10 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:10.709682 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:10.710326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:10.716516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.716964 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.717730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.718161 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.856543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:10.865161 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5b3a60e3-00b3-4bc6-a4d5-3397003320b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.159529 Jul 26 15:07:10.865732 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 170/345] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:10 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:11.189240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:11.189852 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:11.197018 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.204263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.204263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.204263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.347336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:11.355685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-589e8f23-4bc1-4246-85d7-8110e31b6f43 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.170499 Jul 26 15:07:11.356236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 176/346] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:11 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:11.435222 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:11.435772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:11.442717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.443167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.444195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.444637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.574231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:11.581969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-36367723-af2d-451a-8b31-36bfa5e534c4 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.150660 Jul 26 15:07:11.583422 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 171/347] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:11 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:11.887326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:11.887968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:11.894147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.894597 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.895576 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.896025 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.034322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.042095 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ccf2e81e-0db3-4ab4-96b7-f70dda433444 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.158942 Jul 26 15:07:12.042669 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 177/348] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:11 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:12.377122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:12.377720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:12.384610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.385056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.385828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.386258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.532720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.541569 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-073db46f-cb5a-4cb5-8b42-eccef74f727d tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.168599 Jul 26 15:07:12.542158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 172/349] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:12 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:12.604753 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:12.605422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:12.611487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.611955 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.612713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.613145 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.753927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.765159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c491018e-a10d-45a6-ab49-8401c44a81e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.163914 Jul 26 15:07:12.766159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 178/350] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:12 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:13.063922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:13.064604 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:13.072114 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.072618 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.073432 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.073878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.233738 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:13.242637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-703436b0-034f-4461-88f8-d092c49cd4f9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.182621 Jul 26 15:07:13.245544 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 173/351] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:13 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:13.563548 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:13.564157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:13.571846 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.572297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.573080 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.573517 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.745224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:13.755946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4243959a-c757-45dc-acb0-331f39516a74 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.195915 Jul 26 15:07:13.756829 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 179/352] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:13 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:13.788887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:13.789330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:13.797864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.798417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.799431 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.799970 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.966333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:13.974979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-27469e7c-a3c4-441d-98e5-824d5ba79302 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.191814 Jul 26 15:07:13.978021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 174/353] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:13 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:14.274151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:14.274996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:14.284209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.297506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.297506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.297506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.444654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:14.452580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b422c06f-2d3d-4744-aae3-fd57351f9575 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.185847 Jul 26 15:07:14.453163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 180/354] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:14 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:14.784998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:14.785613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:14.792142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.792769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.793341 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.793778 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.941504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:14.949948 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4f175184-dd6a-4e04-85c7-37c9e0b2f67e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.169349 Jul 26 15:07:14.950584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 175/355] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:14 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:15.002662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:15.007104 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:15.010426 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.010874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.011752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.012186 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.154304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.167918 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-047c4ee0-327a-4b7b-ad9a-89fa99a4241a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.168863 Jul 26 15:07:15.168928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 181/356] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:14 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:15.474773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:15.475388 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:15.481470 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.481918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.482685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.483121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.621910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.629568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-84d5d057-17c8-4923-aa85-8b0123062322 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.159063 Jul 26 15:07:15.630075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 176/357] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:15 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:15.971232 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:15.971882 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:15.978255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.980320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.980320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.980320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.112983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:16.121006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-516ded5f-b966-4a1d-8f4c-7bcf2900b305 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.153384 Jul 26 15:07:16.121567 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 182/358] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:15 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:16.193990 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:16.195289 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:16.202891 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.205245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.205245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.205245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.342345 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:16.350678 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7b20e0a8-0c2e-444a-ba82-d69319f861e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.161445 Jul 26 15:07:16.351377 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 177/359] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:16 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:16.555051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-6394e9a0-a961-4c18-bfa2-addfb2bcac26 req-f2a84572-483b-4873-b6e8-fd2e8fe59a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a050fd-1d02-47df-b37b-17f496480a78", "name": "network-vif-plugged", "status": "completed", "tag": "642f8bc5-5d97-4c38-a9b4-6db449ae030e"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:16.564871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-6394e9a0-a961-4c18-bfa2-addfb2bcac26 req-f2a84572-483b-4873-b6e8-fd2e8fe59a80 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.565313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-6394e9a0-a961-4c18-bfa2-addfb2bcac26 req-f2a84572-483b-4873-b6e8-fd2e8fe59a80 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.577804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-6394e9a0-a961-4c18-bfa2-addfb2bcac26 req-f2a84572-483b-4873-b6e8-fd2e8fe59a80 service nova] Creating event network-vif-plugged:642f8bc5-5d97-4c38-a9b4-6db449ae030e for instance 43a050fd-1d02-47df-b37b-17f496480a78 on hv-cinder-85066 Jul 26 15:07:16.583406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-6394e9a0-a961-4c18-bfa2-addfb2bcac26 req-f2a84572-483b-4873-b6e8-fd2e8fe59a80 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033343 Jul 26 15:07:16.587006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 183/360] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:16.650677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:16.651297 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:16.657650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.658281 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.659063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.659514 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.679758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:16.808374 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:16.826539 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7ffc0173-adf1-4374-8187-87e2a20b8b3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.179739 Jul 26 15:07:16.827118 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 178/361] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:16 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:17.142961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:17.143649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:17.150658 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.151099 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.151888 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.152320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.297018 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:17.304309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1055dd61-498b-447e-8158-b759413d1468 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.165504 Jul 26 15:07:17.304898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 184/362] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:17 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:17.373520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:17.376557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:17.381821 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.382273 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.383116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.383617 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.525709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:17.532826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f2189531-00f6-47da-8163-d2d5943c39de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.163445 Jul 26 15:07:17.533382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 179/363] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:17 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:17.544366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:17.544987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:17.550973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.554220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.554220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.554220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.577937 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cbad0c53-97c9-4bbd-ab12-d145c3e3d2c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/ips" status: 200 len: 151 microversion: 2.1 time: 0.037514 Jul 26 15:07:17.578510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 185/364] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:07:17 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:17.848825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:17.849460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:17.855433 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.855907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.856663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.857086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.004686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.013178 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4c24a46b-4fd0-4d3b-961a-9565eb718e52 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.168836 Jul 26 15:07:18.013901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 180/365] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:17 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:18.326380 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:18.326990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:18.333599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.334141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.334959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.335392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.478026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.485937 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4c98997d-309b-4bdb-96e6-3a07d687432e tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.163406 Jul 26 15:07:18.486601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 186/366] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:18 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:18.554855 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:18.555660 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:18.562532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.563045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.563920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.564418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.701511 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.708936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-617eacdf-f2a1-4edb-983c-7eac19afb35a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.158283 Jul 26 15:07:18.709538 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 181/367] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:18 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:19.034771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:19.035967 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:19.042209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.042656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.043422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.043887 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.171368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:19.179600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7f28db77-085b-455d-9649-8b8c993da053 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.148691 Jul 26 15:07:19.180161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 187/368] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:19 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:19.507155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:19.507791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:19.516302 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.516302 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.516302 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.516302 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.652652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:19.661185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1a631a42-5050-40c5-a974-1ee519c64cce tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.157389 Jul 26 15:07:19.661853 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 182/369] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:19 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:19.730364 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:19.731051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:19.737398 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.737844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.738666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.739108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.877142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:19.885106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8679fd05-8de3-47b1-93b1-61fc1c639b0f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.158582 Jul 26 15:07:19.885879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 188/370] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:19 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:20.202517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:20.203315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:20.209923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.210381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.211248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.211739 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.300451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-604bb59f-45f6-4531-baff-43ca17a647c7 req-0de3ed71-6f04-4c1b-a494-70602056fa7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde", "name": "network-vif-plugged", "status": "completed", "tag": "8c8dadd9-04ed-4a57-81f8-f4cbde8cee8d"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:20.311368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-604bb59f-45f6-4531-baff-43ca17a647c7 req-0de3ed71-6f04-4c1b-a494-70602056fa7c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.311835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-604bb59f-45f6-4531-baff-43ca17a647c7 req-0de3ed71-6f04-4c1b-a494-70602056fa7c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.324040 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-604bb59f-45f6-4531-baff-43ca17a647c7 req-0de3ed71-6f04-4c1b-a494-70602056fa7c service nova] Creating event network-vif-plugged:8c8dadd9-04ed-4a57-81f8-f4cbde8cee8d for instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde on hv-cinder-85066 Jul 26 15:07:20.332691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-604bb59f-45f6-4531-baff-43ca17a647c7 req-0de3ed71-6f04-4c1b-a494-70602056fa7c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Jul 26 15:07:20.337893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 189/371] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:20.361106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:20.370277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-23a0b46d-a982-4485-bdba-1124cdc66443 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.171763 Jul 26 15:07:20.372239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 183/372] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:20 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:20.482742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b8b50b-143c-4553-922b-e5241cde486e"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:20.483555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:20.498016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.498504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.499307 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.499774 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.683236 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:20.683885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:20.690476 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.690921 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.691826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.692249 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.830840 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:20.839242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f67cc668-efba-42b3-9b97-593dec3d8a45 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.160071 Jul 26 15:07:20.839904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 184/373] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:20 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:20.906766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:20.907400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:20.914353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.914834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.915655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.916088 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.052905 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:21.060669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f3403320-858f-4f92-9efa-ea776d748897 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.157690 Jul 26 15:07:21.061240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 185/374] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:20 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:21.065823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:21.066314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:21.080716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.082958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.082958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.083225 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.109159 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-347b9d66-db6b-4999-9424-0dd70789160f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/ips" status: 200 len: 146 microversion: 2.1 time: 0.046859 Jul 26 15:07:21.109738 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 186/375] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:07:21 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:21.391839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:21.392445 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:21.398400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.398842 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.399635 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.400082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.547812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:21.562849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e83c31dd-f68d-4169-bdc2-9b82e69c7ec1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.174689 Jul 26 15:07:21.563560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 187/376] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:21 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:21.861192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:21.861864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:21.868918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.869351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.870108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.870793 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.007430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.015105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cecf48be-e228-41e2-ba75-d1a6cbd75f50 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.157758 Jul 26 15:07:22.015705 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 188/377] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:21 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:22.083807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:22.084712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:22.092222 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.092675 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.093492 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.093937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.241860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.249795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5c67ea1d-3f58-4af4-9a1f-ec4203134139 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.171333 Jul 26 15:07:22.266206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 189/378] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:22 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:22.585750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:22.586367 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:22.592919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.593364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.594138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.594575 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.742785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.750941 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4a958ec4-d094-458a-a140-ead80fc321a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.169154 Jul 26 15:07:22.751662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 190/379] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:22 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:23.036986 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:23.037674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:23.044243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.044785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.045623 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.046125 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.182402 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:23.190023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4695d9c3-2258-4475-88be-5698698e3fb9 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.157566 Jul 26 15:07:23.190495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 191/380] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:23 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:23.275178 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:23.275832 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:23.282420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.282870 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.283676 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.284187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.424607 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:23.432195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f8fe65b4-a23b-4562-9c6f-da2301f0a7f3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.162531 Jul 26 15:07:23.432767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 192/381] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:23 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:23.776782 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:23.777705 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:23.779649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=91 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:23.784934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.787873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.787873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.787873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.920884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:23.929418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3ffe2537-dba6-4fd1-9e0f-6c0a2395fb87 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.156914 Jul 26 15:07:23.930005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 193/382] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:23 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:24.212907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:24.214218 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:24.220965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.222037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.222979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.223716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.392313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:24.401461 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c9250574-fdcf-43f6-9d72-b04c12320047 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.192384 Jul 26 15:07:24.407629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 194/383] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:24 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:24.453733 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:24.454348 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:24.460685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.461139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.461908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.462347 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.480821 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:24.615203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:24.625008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-075d8448-ee6c-481c-83b6-bb4367bd7018 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1319 microversion: 2.1 time: 0.175058 Jul 26 15:07:24.625638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 195/384] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:24 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:24.791072 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-675def94-5535-41e7-b169-ff617c08cac8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.321599 Jul 26 15:07:24.797099 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 190/385] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:07:20 2022] POST /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments => generated 194 bytes in 4328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:24.950083 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:24.950685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:24.957655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.958088 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.959028 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.959491 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.103814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.112060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-55b5ba6c-03c0-490a-bf29-417c503b36a0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.165769 Jul 26 15:07:25.112633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 196/386] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:24 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:25.427195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:25.427919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:25.434637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.435108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.435916 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.436352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.570186 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.574039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:25.578354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5a00060e-0bfd-426e-ac29-ae3fee27e27a tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.155847 Jul 26 15:07:25.578919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 191/387] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:25 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:25.649015 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:25.649587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:25.656726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.657170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.657970 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.658645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.854013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.865972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c1de4de0-7bec-435d-a5e7-c016301940ef tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1508 microversion: 2.1 time: 0.223461 Jul 26 15:07:25.866891 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 197/388] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:25 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:25.954550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af8dace4-5e8b-4dfd-8300-e8bcc835fbc3"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:25.966997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:25.997754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.998207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.998982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.999412 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.134955 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:26.138185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:26.141889 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.142306 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.143080 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.143542 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.328219 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:26.338696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8cead163-e068-40eb-bfc4-3c62108b9e42 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.208309 Jul 26 15:07:26.339276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 198/389] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:26 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:26.600988 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:26.601699 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:26.608387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.608912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.609749 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.610271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.755518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:26.763439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0abda2a2-38db-427c-9e5f-dcaafaed949b tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1314 microversion: 2.1 time: 0.166537 Jul 26 15:07:26.764027 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 199/390] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:26 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:27.361309 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:27.361888 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:27.368685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:27.369172 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:27.369934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:27.370644 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:27.510427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:27.518099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-87b074bf-5c95-4e7e-b618-80d8d11f86ab tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.161212 Jul 26 15:07:27.518669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 200/391] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:27 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:27.788193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:27.788981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:27.797785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:27.797785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:27.797785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:27.797785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:27.942565 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:27.951305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b446c746-c897-4a0c-b0aa-64b8576c54af tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1499 microversion: 2.1 time: 0.167163 Jul 26 15:07:27.952366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 201/392] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:27 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:28.082861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d65e0a2e-266e-4ea0-ba94-f0e907e480ec tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.131782 Jul 26 15:07:28.083990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 192/393] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:07:25 2022] POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-volume_attachments => generated 194 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:28.549386 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:28.550138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:28.556959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:28.557630 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:28.558714 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:28.559392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:28.786581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:28.803170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1ef832b7-7319-45d7-bec4-0f72007a3fa8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.260380 Jul 26 15:07:28.817183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 202/394] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:28 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:29.372997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:29.375374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:29.384761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.390019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.390019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.390019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.412552 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:07:29.778219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e1574da3-deb5-40bf-82ae-b89baf53d3c3 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "DELETE /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 204 len: 0 microversion: 2.1 time: 0.411051 Jul 26 15:07:29.778809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 193/395] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:07:29 2022] DELETE /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:07:29.787382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:29.788130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:29.794472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.794928 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.795729 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.796158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.847879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:29.847879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:29.852616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.853070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.855303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.855775 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.965758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:29.977196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b01f0775-58f7-46f1-b225-c5ac5577be12 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1505 microversion: 2.1 time: 0.193851 Jul 26 15:07:29.977783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 203/396] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:29 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:30.046456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:30.056212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-99ec3f52-08d4-403a-b421-6033f4957e3d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.223259 Jul 26 15:07:30.057083 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 194/397] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:29 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:31.000707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:31.001439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:31.008197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.008672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.009467 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.009909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.081037 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:31.081734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:31.091334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.092342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.093370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.094093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.179366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:31.190720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2cc724bb-7b78-4234-bb56-a9a027c227ad tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1505 microversion: 2.1 time: 0.194345 Jul 26 15:07:31.191311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 204/398] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:30 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:31.275622 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:31.287944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d172936e-8554-4f31-9ff5-59fe5347bc24 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.213421 Jul 26 15:07:31.288542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 195/399] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:31 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:32.214233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:32.214852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:32.221614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.222145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.223014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.223452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.310461 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:32.311128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:32.318168 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.319492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.319492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.319885 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.367126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:32.375481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-658968bf-3656-40a0-92ba-fac12b1ab1e7 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1505 microversion: 2.1 time: 0.165073 Jul 26 15:07:32.376246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 205/400] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:32 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:32.482028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:32.496368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-86d3f694-5681-401f-a7f2-4fd4d2fe5c4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.190176 Jul 26 15:07:32.497153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 196/401] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:32 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:33.398296 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:33.398923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:33.405056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:33.405501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:33.406258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:33.406691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:33.526622 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:33.527497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:33.534809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:33.535840 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:33.537904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:33.539022 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:33.576369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:33.597217 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8384aaa7-be7d-46f7-9b54-2c6b86d42c89 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1505 microversion: 2.1 time: 0.200533 Jul 26 15:07:33.603820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 206/402] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:33 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:33.770758 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:33.779944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e48f8fca-bc5f-4983-afec-763f202fd7d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.260002 Jul 26 15:07:33.780628 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 197/403] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:33 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:34.635062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:34.635062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:34.643030 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.643589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.644343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.647695 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.734930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:34.750592 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ecfcfe4e-b573-4e0c-9f89-8335c09ed495 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1463 microversion: 2.1 time: 0.131468 Jul 26 15:07:34.751214 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 207/404] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:34 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1463 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:34.803633 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:34.804153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:34.811269 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.811770 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.812550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.813258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.870632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-ada50acf-651e-41c0-9a7f-95de9f242e5f req-99cd1640-1885-46be-87c2-18c77df5f88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde", "name": "network-vif-deleted", "tag": "8c8dadd9-04ed-4a57-81f8-f4cbde8cee8d"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:34.902514 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-ada50acf-651e-41c0-9a7f-95de9f242e5f req-99cd1640-1885-46be-87c2-18c77df5f88f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.904138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-ada50acf-651e-41c0-9a7f-95de9f242e5f req-99cd1640-1885-46be-87c2-18c77df5f88f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.948697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-ada50acf-651e-41c0-9a7f-95de9f242e5f req-99cd1640-1885-46be-87c2-18c77df5f88f service nova] Creating event network-vif-deleted:8c8dadd9-04ed-4a57-81f8-f4cbde8cee8d for instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde on hv-cinder-85066 Jul 26 15:07:34.957276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-ada50acf-651e-41c0-9a7f-95de9f242e5f req-99cd1640-1885-46be-87c2-18c77df5f88f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091873 Jul 26 15:07:34.958190 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 208/405] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:35.110741 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:35.119617 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f607a70c-3f93-45c2-9114-64845ac0b460 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.322356 Jul 26 15:07:35.120653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 198/406] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:34 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:35.779705 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:35.780648 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:35.790212 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:35.790659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:35.791445 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:35.791916 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:35.914305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:35.926154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-df34fa97-5f4c-4a62-8518-03052b83fb31 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1299 microversion: 2.1 time: 0.155153 Jul 26 15:07:35.927047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 209/407] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:35 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:36.148128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:36.152998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:36.166807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.167265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.168086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.168525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.338992 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-89c25272-6353-4ab1-b7c3-2c7addfa1cc2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: .version_select at 0x7f4532afeee0>, body: {"keypair": {"name": "tempest-keypair-1310210035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXfybBBp0QzGJWV/3ypISayAUOM5VrdVVs2hAFfoZIcqPk8Q2NyAEn3RhC6mjvE9rr4eAr3Kwy0sBauT2/UuHnaN1bQqWE6Ar06MtgTqkreqEQve7hVnjcAwlpj1uanUg=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:36.362871 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-89c25272-6353-4ab1-b7c3-2c7addfa1cc2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:07:36.370315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-89c25272-6353-4ab1-b7c3-2c7addfa1cc2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:07:36.405861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:36.424733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2ada09a1-49b7-41ef-ba60-d753f42bc965 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1502 microversion: 2.1 time: 0.283871 Jul 26 15:07:36.445552 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 199/408] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:36 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:36.468687 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51cb4d25-a5bc-4481-b116-d4dd342d0072"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:36.471997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:36.481691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.484612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.484612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.484612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.518521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-89c25272-6353-4ab1-b7c3-2c7addfa1cc2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184842 Jul 26 15:07:36.519443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 210/409] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:07:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:36.650582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] HTTP exception thrown: Cannot 'attach_volume' instance ebca4e54-4a78-49e4-b381-6cd1203b3535 while it is in vm_state rescued Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Request method failure captured: Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/os-volume_attachments HTTP/1.1 Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 74 Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKkQwkN3TagUDUk9HIaFCgKq5VIVpVl1_6IKGwkUeOUZwhg3tMuoFdBv2bbZaor_FwC0R6DGzOt9R7Ja_jW00cfy9h6j5CTElqBbFyGpf-gK51Hv_9q_KIo60Kqy4qSqMNCjYrN6u1pdxMAUMSoYOT4sLfYzhBP5Svvw3qBb83WRlU Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:07:36.653003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 61b3efca1989483d960b9f92d655d39e Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {"volumeAttachment": {"volumeId": "51cb4d25-a5bc-4481-b116-d4dd342d0072"}} Jul 26 15:07:36.662816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Cannot 'attach_volume' instance ebca4e54-4a78-49e4-b381-6cd1203b3535 while it is in vm_state rescued Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'server_id': 'ebca4e54-4a78-49e4-b381-6cd1203b3535', 'body': {'volumeAttachment': {'volumeId': '51cb4d25-a5bc-4481-b116-d4dd342d0072'}}} Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:07:36.664277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ebca4e54-4a78-49e4-b381-6cd1203b3535 while it is in vm_state rescued Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:36.667356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ebca4e54-4a78-49e4-b381-6cd1203b3535 while it is in vm_state rescued Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Returning 409 to user: Cannot 'attach_volume' instance ebca4e54-4a78-49e4-b381-6cd1203b3535 while it is in vm_state rescued {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fb3a8e12-93d6-4b6f-9f01-df0f76bb5d4b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.195332 Jul 26 15:07:36.671178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 200/410] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:07:36 2022] POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/os-volume_attachments => generated 152 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 15:07:36.673648 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:36.674804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:36.682683 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.683289 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.684465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.684974 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.927745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8db30851-b9a8-4e13-8837-9d50c4d607f5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/action" status: 202 len: 0 microversion: 2.1 time: 0.261649 Jul 26 15:07:36.929279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 211/411] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:07:36 2022] POST /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:07:36.938172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:36.946856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:36.954371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:36.955722 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:36.966152 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.967301 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.968042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.968510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.968767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.969318 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.969521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.969757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:37.074817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:37.075379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:37.075887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lazy-loading 'fault' on Instance uuid 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:07:37.096664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:37.226091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:37.236967 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-88d3c90b-b1b3-4fd2-a262-c0cf37aa74ef tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1510 microversion: 2.1 time: 0.302941 Jul 26 15:07:37.258102 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 201/412] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:36 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:37.288857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf28a5c061c42668fc54a0c50af64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4272758d01274f419bc75c85140daa06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:37.298705 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2dfeb9d5-ad91-4aca-b1f9-9a12c48c8da5 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 200 len: 1304 microversion: 2.1 time: 0.353595 Jul 26 15:07:37.299611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 212/413] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:36 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 1304 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:38.261484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:38.262881 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:38.272893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:38.275086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:38.275777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:38.276569 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:38.277087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:38.321866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:38.323148 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] [instance: 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:38.339116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:38.339887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:38.342769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:38.343448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:38.383171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] HTTP exception thrown: Instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde could not be found. Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Request method failure captured: Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde HTTP/1.1 Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ALrt1MdbfP90Vr_fwpR8HHhoN9CNfupbv5Tuhx4S7nafKh4ZHXrNr2z-2BYgvZVN2DJRh6mZVTud2seEy-aWKMzynAXlq_-q97X2mD711GjtLM_NGLPSAm7GmToU8fpMQvgn59UlqSAsvJKf6F9d2hHFvpjpR87DdRqhK29l7uFf0Q Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 4272758d01274f419bc75c85140daa06 Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesActionsTest-151571423 Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:07:38.386555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_4272758d01274f419bc75c85140daa06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/4272758d01274f419bc75c85140daa06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4272758d01274f419bc75c85140daa06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4272758d01274f419bc75c85140daa06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesActionsTest-151571423 Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 4272758d01274f419bc75c85140daa06 Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesActionsTest-151571423 Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesActionsTest-151571423-project Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 2bf28a5c061c42668fc54a0c50af64ee Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesActionsTest-151571423-project Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde could not be found. Jul 26 15:07:38.387904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde'} Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde could not be found. Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:07:38.388687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde could not be found. Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde could not be found. Jul 26 15:07:38.389810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:07:38.390954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] Returning 404 to user: Instance 8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:07:38.390954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-66855851-2496-4e7a-adbd-be0c32f89a84 tempest-VolumesActionsTest-151571423 tempest-VolumesActionsTest-151571423-project] 10.222.0.94 "GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde" status: 404 len: 111 microversion: 2.1 time: 0.074391 Jul 26 15:07:38.391608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 213/414] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:38 2022] GET /compute/v2.1/servers/8786fd30-cfed-4d9b-bfa7-eeb64ffe0dde => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:07:38.926132 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:38.937782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cacdf076-9cd1-4bbd-bc1a-ddcd36c8568e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1510 microversion: 2.1 time: 0.680290 Jul 26 15:07:38.939736 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 202/415] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:38 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1510 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:39.976112 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:39.976850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:40.000965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:40.003150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:40.004016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:40.007673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:40.574248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:40.588291 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9f8e7f0e-ff41-4260-9cc5-6d37618fe493 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1510 microversion: 2.1 time: 0.628436 Jul 26 15:07:40.591079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 214/416] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:39 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:40.923695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1523187548", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd3e2f67-4b42-4920-a974-5409190c3fa7"}], "security_groups": [{"name": "tempest-securitygroup--1047891609"}], "key_name": "tempest-keypair-1310210035", "user_data": "}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:42.071167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:42.071167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:42.071167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:42.071167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:42.072927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:42.072927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:42.072927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:42.073845 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2b58f933-27f6-4943-8007-8038f060d62e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1516 microversion: 2.1 time: 0.375028 Jul 26 15:07:42.073845 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 215/417] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:41 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1516 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:44.096754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] validate_networks() for [('bd3e2f67-4b42-4920-a974-5409190c3fa7', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:07:44.213602 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-387813db-5d6b-43fa-a146-0c15b7f5d37d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'create', calling method: .version_select at 0x7f4532babf70>, body: {"keypair": {"name": "tempest-keypair-1683368579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/TiDsYcE9/k1Fe53ztjO5o3XHgfbpJyeQWsXQHZssNWHr43+XGXIGvovj/6a6uiNP5m4io1FCBp2nqg2d2TN05YJKm3nydhuldvWDQuck5Bx41Epc8yaN2oKmRw9sDg=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:44.263371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-387813db-5d6b-43fa-a146-0c15b7f5d37d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for project dbe01616efc64d2e901f45662e7c3518. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:07:44.273015 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-387813db-5d6b-43fa-a146-0c15b7f5d37d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for user 61b3efca1989483d960b9f92d655d39e and project dbe01616efc64d2e901f45662e7c3518. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:07:44.417265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-387813db-5d6b-43fa-a146-0c15b7f5d37d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209720 Jul 26 15:07:44.418290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 216/418] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:07:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:44.429603 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0d524dad-048a-44d2-9839-82af32ff36f2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:44.444985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d524dad-048a-44d2-9839-82af32ff36f2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:44.446130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d524dad-048a-44d2-9839-82af32ff36f2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:44.584697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0d524dad-048a-44d2-9839-82af32ff36f2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Going to try to stop instance {{(pid=130762) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 15:07:44.816960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0d524dad-048a-44d2-9839-82af32ff36f2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.391737 Jul 26 15:07:44.816960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 217/419] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:07:44 2022] POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:07:44.850354 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:44.854707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:44.878215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:44.880529 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:44.883323 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:44.883323 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:45.105442 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:45.128064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-57b31296-bd27-450c-83ec-590b7031a3bd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.302256 Jul 26 15:07:45.131987 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 218/420] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:44 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:45.236251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:07:45.236775 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:07:45.237151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:07:45.237564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:07:45.238597 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:07:45.257927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:45.258379 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:45.259179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:45.259674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:45.292134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:07:45.296437 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:07:45.312250 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:07:45.314766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:07:45.440650 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f246bf97-76d2-4b7a-aea3-3fccf269076e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.521987 Jul 26 15:07:45.448415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 203/421] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:07:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 4530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:07:45.453182 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-02111695-3c5a-4367-863d-a936ac3e35ba tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:45.454466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-02111695-3c5a-4367-863d-a936ac3e35ba tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:45.531801 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-02111695-3c5a-4367-863d-a936ac3e35ba tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:45.543864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-02111695-3c5a-4367-863d-a936ac3e35ba tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1242 microversion: 2.1 time: 0.094930 Jul 26 15:07:45.545601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 219/422] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:45 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:46.158816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:46.160010 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:46.175547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:46.175547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:46.175547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:46.175547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:46.424985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:46.434843 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3717a478-3b42-4cfd-8c93-1fe924ccea30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.282535 Jul 26 15:07:46.435415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 204/423] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:46 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:46.564410 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1577fae2-cc3f-4d50-b9a8-f98e48a5a8ce tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:46.565011 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1577fae2-cc3f-4d50-b9a8-f98e48a5a8ce tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:46.667410 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1577fae2-cc3f-4d50-b9a8-f98e48a5a8ce tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:46.676033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1577fae2-cc3f-4d50-b9a8-f98e48a5a8ce tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1242 microversion: 2.1 time: 0.115171 Jul 26 15:07:46.677452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 220/424] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:46 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:47.460177 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:47.460797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:47.468746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:47.469579 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:47.470519 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:47.470894 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:47.701468 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:47.708869 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:47.716842 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:47.717546 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:47.718669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:47.719068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:47.903676 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:47.913735 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-802fbfc4-03c6-4879-ae34-6c5cd32e218b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1246 microversion: 2.1 time: 0.218369 Jul 26 15:07:47.930328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 221/425] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:47 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1246 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:48.051052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:48.080976 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cca6d6ed-1aab-49cf-8b31-49780c172283 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.616843 Jul 26 15:07:48.080976 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 205/426] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:47 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:48.606947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-741222805", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d3dae5-c67b-4195-9daa-754dae1d5468"}], "security_groups": [{"name": "tempest-securitygroup--1551932251"}], "key_name": "tempest-keypair-1683368579", "user_data": "}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:48.737574 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] validate_networks() for [('a8d3dae5-c67b-4195-9daa-754dae1d5468', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:07:48.938447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:48.940569 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:48.950398 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:48.951041 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:48.952031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:48.952632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:48.992254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:49.047601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:49.061545 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e85f84bf-f3a0-47f0-87c9-f41397774771 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1238 microversion: 2.1 time: 0.130848 Jul 26 15:07:49.062763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 206/427] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:48 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:49.102965 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:49.103634 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:49.116251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:49.117354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:49.120137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:49.122651 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:49.506287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:07:49.507759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:07:49.507921 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:07:49.508486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:07:49.509053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:07:49.524144 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:49.524889 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:49.528252 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:49.529041 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:49.555252 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for project dbe01616efc64d2e901f45662e7c3518. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:07:49.564912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Getting quotas for user 61b3efca1989483d960b9f92d655d39e and project dbe01616efc64d2e901f45662e7c3518. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:07:49.609067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:07:49.616118 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:07:49.670457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:49.790374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:49.819811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5b3393c7-16a9-43c2-b5ea-5890afbe8c90 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.721439 Jul 26 15:07:49.820419 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 207/428] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:49 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:49.837541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-eb014323-ac01-4885-9b10-593822f94367 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.235279 Jul 26 15:07:49.839188 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 222/429] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:07:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:07:49.854131 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-052625c8-7529-4e90-ad9e-819db798de32 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:49.854643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-052625c8-7529-4e90-ad9e-819db798de32 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:50.007324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-052625c8-7529-4e90-ad9e-819db798de32 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:50.020312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-052625c8-7529-4e90-ad9e-819db798de32 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1245 microversion: 2.1 time: 0.168609 Jul 26 15:07:50.022691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 208/430] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:49 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1245 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:50.101392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:50.103724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:50.134984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:50.135442 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:50.136408 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:50.143783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:50.422107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:50.436139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8ab2fbee-18e1-404f-8f27-d49b6fbac55d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1294 microversion: 2.1 time: 0.353989 Jul 26 15:07:50.451648 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 223/431] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:50 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1294 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:50.845689 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:50.846367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:50.864427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:50.866037 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:50.867210 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:50.868007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:51.047297 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-506e9204-3fc3-4ac0-a63f-9cd515540602 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:51.048224 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-506e9204-3fc3-4ac0-a63f-9cd515540602 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:51.291214 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-506e9204-3fc3-4ac0-a63f-9cd515540602 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:51.303682 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-506e9204-3fc3-4ac0-a63f-9cd515540602 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1245 microversion: 2.1 time: 0.257569 Jul 26 15:07:51.313259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 224/432] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:51 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1245 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:51.404815 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:51.423690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-66df1581-1f19-45ad-96fb-9b8ead6b48d8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.582103 Jul 26 15:07:51.426568 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 209/433] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:50 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:51.467165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:51.468555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:51.476852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:51.477502 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:51.478455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:51.479133 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:51.620275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:51.632511 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e73d17b4-3d23-4c70-aa52-47e18edfc052 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1300 microversion: 2.1 time: 0.172712 Jul 26 15:07:51.633759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 225/434] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:51 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1300 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:52.371492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:52.371492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:52.392177 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:52.392625 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:52.402327 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:52.413716 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:52.451532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:52.452070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:52.471271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:52.471769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:52.472528 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:52.486360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:52.634058 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:52.672606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-965fdb65-d767-46aa-b8a2-e53c9552ba69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1241 microversion: 2.1 time: 0.321437 Jul 26 15:07:52.673289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 210/435] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:52 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1241 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:52.694249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:52.694906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:52.728052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:52.728490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:52.729258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:52.729686 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:53.060291 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:53.070648 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-839576c8-f261-494a-869b-16aa7a85e7ff tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.624964 Jul 26 15:07:53.072055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 226/436] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:52 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:53.250857 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:53.279968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-75a20d93-ba4c-496a-b15e-5236c88e2218 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.605332 Jul 26 15:07:53.281382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 211/437] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:52 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:53.703321 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:53.705300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:53.725207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:53.725659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:53.726448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:53.726873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:54.098653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:54.101381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:54.153961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:54.169804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:54.170724 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:54.171183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:54.280294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:54.302267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-13dc52a4-1418-421e-84e4-d4c4340f5d53 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1305 microversion: 2.1 time: 0.594388 Jul 26 15:07:54.302267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 227/438] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:53 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1305 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:54.314509 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:54.315232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:54.340214 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:54.349371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:54.354534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:54.355213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:54.816486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:54.832165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-826bf4e6-2fa7-4a90-86c0-5f8622f78be4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.522239 Jul 26 15:07:54.835096 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 228/439] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:54 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:54.884865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:54.920371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-27a0e823-8fce-4f0a-acba-eef63da1a37d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.831063 Jul 26 15:07:54.921019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 212/440] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:54 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:55.292160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "738f9677-1ffd-405b-8893-72f4c560e84b", "device": "/dev/sdb"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:55.295282 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:55.313746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.314198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:55.314996 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.315433 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:55.334772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:55.335436 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:55.338113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:55.366555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.367935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:55.368779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.369221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:55.793510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:55.815059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-684d7772-e477-46e6-9d4c-2a129b6279d5 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1303 microversion: 2.1 time: 0.484396 Jul 26 15:07:55.841668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 213/441] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:55 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1303 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:55.860718 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-f4a9fa29-d431-4b5f-a23a-15e2fd82ae61 req-3928e97c-c9a7-486b-bbab-47c2ada51ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22db4394-5de8-471c-8738-b0484e5f7032", "tag": "58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:55.884161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-f4a9fa29-d431-4b5f-a23a-15e2fd82ae61 req-3928e97c-c9a7-486b-bbab-47c2ada51ae0 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.884602 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-f4a9fa29-d431-4b5f-a23a-15e2fd82ae61 req-3928e97c-c9a7-486b-bbab-47c2ada51ae0 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:55.906573 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-f4a9fa29-d431-4b5f-a23a-15e2fd82ae61 req-3928e97c-c9a7-486b-bbab-47c2ada51ae0 service nova] Creating event network-changed:58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a for instance 22db4394-5de8-471c-8738-b0484e5f7032 on hv-cinder-85066 Jul 26 15:07:55.908166 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-f4a9fa29-d431-4b5f-a23a-15e2fd82ae61 req-3928e97c-c9a7-486b-bbab-47c2ada51ae0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052904 Jul 26 15:07:55.910065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 214/442] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:55.928438 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:55.929407 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:55.962581 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.963564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:55.965775 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:55.966382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:56.388779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:56.413088 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a5c00a17-02a9-41f0-a3e5-e206fe37e387 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.498658 Jul 26 15:07:56.417078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 215/443] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:55 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:56.458491 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:56.470095 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:56.480031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:56.480761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:56.481731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:56.487761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:56.854546 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-83893de2-6e63-49a5-923a-a2b70f4a510f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "POST /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.566354 Jul 26 15:07:56.873959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 229/444] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:07:55 2022] POST /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78/os-volume_attachments => generated 194 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:56.873959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:56.881076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:56.894129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:56.895541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:56.896874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:56.897514 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:57.015993 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:57.036751 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-66d25ea8-a52c-414c-a54e-24824bd61eea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.617278 Jul 26 15:07:57.039619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 216/445] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:56 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:57.106673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:57.111823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e3761bd5-7616-4309-a6de-0509dd334eb3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1303 microversion: 2.1 time: 0.253274 Jul 26 15:07:57.133356 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 230/446] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:56 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1303 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:57.447363 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:57.452242 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:57.472038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:57.472624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:57.488555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:57.489339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:57.812200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:57.829769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-74da7872-7547-4e0b-8949-d92c5344d44c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.381377 Jul 26 15:07:57.841473 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 217/447] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:57 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:58.090880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:58.093435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:58.108825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:58.110726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:58.112065 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:58.112818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:58.140564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:58.142111 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:58.178045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:58.187260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:58.187260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:58.197153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:58.510924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:58.529107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a3aac8f8-4b90-4b0b-aa59-eb6d9a14abef tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.443592 Jul 26 15:07:58.544421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 231/448] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:58 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:58.853232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:58.856073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:58.861577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:58.862313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:58.863196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:58.863958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:58.869345 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:59.047951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:59.072672 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1cc9d107-038b-45a2-ab87-bec3f4a6b8e4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.935685 Jul 26 15:07:59.074162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 218/449] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:58 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:59.111948 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:59.122380 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-53f2b093-da25-4c7d-97d3-adaf4a623e9f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.274715 Jul 26 15:07:59.124051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 232/450] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:58 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:59.564612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:59.566155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:59.576462 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:59.585057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:59.585057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:59.585057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:59.894267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:59.903988 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-086b8705-83a8-4b8c-be5f-4765fdd2cb48 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.345874 Jul 26 15:07:59.904849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 219/451] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:59 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:00.095689 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:00.097497 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:00.104335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:00.118363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.119170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:00.120175 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.120634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:00.147570 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:00.149571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:00.152193 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=8 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:00.164814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.166039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:00.169902 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.170678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:00.392637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:00.409053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cbd16e4b-a611-4c01-b274-195c2a694e7b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.318138 Jul 26 15:08:00.409631 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 233/452] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:00 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:00.620004 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-87ddf77b-3df0-47ce-ad70-5b12f439a2b0 req-6e127a02-b910-423c-a14d-8c129d13fc94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530f5891-c2f5-4273-8ef0-c733ef667dc3", "tag": "4f4c8eee-d209-4040-b613-9be1c6f38ffd"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:00.652394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-87ddf77b-3df0-47ce-ad70-5b12f439a2b0 req-6e127a02-b910-423c-a14d-8c129d13fc94 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.652955 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-87ddf77b-3df0-47ce-ad70-5b12f439a2b0 req-6e127a02-b910-423c-a14d-8c129d13fc94 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:00.702023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-87ddf77b-3df0-47ce-ad70-5b12f439a2b0 req-6e127a02-b910-423c-a14d-8c129d13fc94 service nova] Creating event network-changed:4f4c8eee-d209-4040-b613-9be1c6f38ffd for instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 on hv-cinder-85066 Jul 26 15:08:00.725695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:00.730336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-87ddf77b-3df0-47ce-ad70-5b12f439a2b0 req-6e127a02-b910-423c-a14d-8c129d13fc94 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115842 Jul 26 15:08:00.731427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 234/453] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:00.763639 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fc7729ee-ba03-4232-bf61-24b3b94aafb2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.612685 Jul 26 15:08:00.768744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 220/454] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:00 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:00.928086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:00.929401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:00.937837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.938722 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:00.939772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:00.940538 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:01.175495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:01.192250 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-384c4369-d197-448d-a68d-407d958dc9f7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.269628 Jul 26 15:08:01.210102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 235/455] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:00 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:01.430354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:01.430950 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:01.438824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:01.439411 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:01.444550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:01.444550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:01.793585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:01.794637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:01.804939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=20 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:01.811360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:01.813626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:01.814531 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:01.815073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:01.897728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:01.906856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-df3f6315-d8a2-4702-b1d7-f5b679b92e9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.480299 Jul 26 15:08:01.911263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 221/456] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:01 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:02.173141 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:02.189918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-30471e26-9675-4b2b-a468-51bf88422b76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.403596 Jul 26 15:08:02.194544 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 236/457] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:01 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:02.220190 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:02.221614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:02.235956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:02.236884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:02.238332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:02.239944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:02.431776 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e795d106-3b23-4ca9-9182-1c0dc1bdd030 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Action: 'create', calling method: .version_select at 0x7f45375e5c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-158600999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsgK8JcUTrXDjbNdCIcS0wwHW2SnjRbg3fLYTkA6nLF8/J+LeFZ+NoaogmqH5YIMBPSrpKasGlvYdGLt6tdhRot0Ygmg3NBeJRIauVqjYq07OFihUmjZe3p+wMZutrm5w=="}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:02.482308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-e795d106-3b23-4ca9-9182-1c0dc1bdd030 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Getting quotas for project a9f0ab2fc6e64eada5f55a0f0a835073. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:08:02.490490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-e795d106-3b23-4ca9-9182-1c0dc1bdd030 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Getting quotas for user 2fc5fd88556145fda1fb0067d5e9adcc and project a9f0ab2fc6e64eada5f55a0f0a835073. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:08:02.537622 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:02.556144 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bbae64ed-3fa5-459c-952a-118ac227fcfa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.344925 Jul 26 15:08:02.572530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 237/458] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:02 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:02.638208 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e795d106-3b23-4ca9-9182-1c0dc1bdd030 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.571182 Jul 26 15:08:02.639003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 222/459] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:08:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:02.932945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:02.933637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:02.940606 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:02.944267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:02.945434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:02.946091 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:03.223651 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:03.224275 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:03.252684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:03.260283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:03.265333 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:03.265333 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:03.341777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:03.352993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d0bb0904-327d-45e3-b7d1-dc6a492b907c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.423859 Jul 26 15:08:03.368649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 238/460] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:02 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:03.500699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:03.509600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3598f379-1877-4225-86be-6e10054211e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.291041 Jul 26 15:08:03.510377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 223/461] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:03 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:03.578668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:03.579516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:03.586319 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:03.586799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:03.587621 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:03.588087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:03.791832 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:03.803068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-175d6963-30c8-4313-bc92-d179ee848bf1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.228422 Jul 26 15:08:03.804144 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 239/462] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:03 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:04.378573 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:04.380746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:04.391945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.392752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.395457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.396456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.534232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:04.536438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:04.558542 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.564568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.565904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.567139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.749479 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:04.759615 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ab616f09-19cb-4608-a6d3-3d7159fc19d1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.387784 Jul 26 15:08:04.761046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 224/463] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:04 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:04.828537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:04.828537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:04.838154 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.838858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.839884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.842038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.867401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:04.879501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-044421ac-77b8-455a-9344-eb5963b6a9d0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.348142 Jul 26 15:08:04.880116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 240/464] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:04 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:05.088878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:05.095294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:05.102592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6c0c7f35-6006-47f6-8baf-c3730c4bdaa7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.280577 Jul 26 15:08:05.103583 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 225/465] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:04 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:05.782397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:05.783312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:05.791427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:05.792184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:05.793429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:05.794102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:05.907415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:05.908629 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:05.917595 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:05.918452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:05.919632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:05.920620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.135162 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:06.142811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-54f69379-a80c-4f3d-aee7-c09582f319be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.365172 Jul 26 15:08:06.152472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:06.160761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 241/466] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:05 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:06.164235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-95a55a91-3bd8-468d-ae32-e48fce0d733b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.267457 Jul 26 15:08:06.164858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 226/467] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:05 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:06.167207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:06.168000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:06.183881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.184554 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.185750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.186423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.373969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:06.384246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2466dd39-652b-4b23-9c86-cb70faa42c44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.221293 Jul 26 15:08:06.385151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 242/468] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:06 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:07.166456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:07.167812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:07.175579 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.177274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.178301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.178921 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.193048 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:07.194266 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:07.205447 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.206142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.209256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.210177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.403879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:07.412334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0c225698-dfd3-418e-af5c-8a5a005efe3a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.249611 Jul 26 15:08:07.426819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 227/469] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:07 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:07.428624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:07.432166 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:07.432913 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:07.439303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.439505 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-245decdc-5c21-41eb-acb3-98ed1b43ca32 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.250575 Jul 26 15:08:07.440235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.441909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.442579 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.444093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 243/470] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:07 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:07.597546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:07.606718 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b29d1f98-1376-40da-984e-87253473d90e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.178584 Jul 26 15:08:07.607297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 228/471] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:07 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:08.434103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:08.434937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:08.441651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.451975 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.451975 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.451975 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.466293 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:08.467124 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:08.476051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.477479 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.481203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.495755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.618609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:08.629989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e49db68a-6ba2-4949-8b2b-19ef28c4a743 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.200051 Jul 26 15:08:08.631376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 244/472] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:08 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:08.637018 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:08.653979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:08.667016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.667944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.668969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.669626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.723521 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:08.736684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-85912220-d71c-4fae-82f9-c1825e66187c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.274293 Jul 26 15:08:08.737619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 229/473] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:08 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:08.848520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:08.861240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a6753803-baa2-4149-8f4e-8b622d642d77 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.228211 Jul 26 15:08:08.864466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 245/474] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:08 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:09.147482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-c33739db-8339-4fe4-a05c-990eb069c520 req-5d09f944-0183-422f-b49b-b57075d46b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22db4394-5de8-471c-8738-b0484e5f7032", "name": "network-vif-plugged", "status": "completed", "tag": "58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:09.159372 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-c33739db-8339-4fe4-a05c-990eb069c520 req-5d09f944-0183-422f-b49b-b57075d46b5e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.160405 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-c33739db-8339-4fe4-a05c-990eb069c520 req-5d09f944-0183-422f-b49b-b57075d46b5e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:09.180177 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-c33739db-8339-4fe4-a05c-990eb069c520 req-5d09f944-0183-422f-b49b-b57075d46b5e service nova] Creating event network-vif-plugged:58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a for instance 22db4394-5de8-471c-8738-b0484e5f7032 on hv-cinder-85066 Jul 26 15:08:09.190375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-c33739db-8339-4fe4-a05c-990eb069c520 req-5d09f944-0183-422f-b49b-b57075d46b5e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048259 Jul 26 15:08:09.191860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 230/475] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:09.662694 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:09.664413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:09.675188 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.675724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:09.677094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.677857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:09.761228 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:09.763078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:09.775339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.778246 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:09.781773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.782517 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:09.857969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:09.885773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7c1ece69-ef9a-49df-a984-673d11546d0f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.213695 Jul 26 15:08:09.885773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 246/476] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:09 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:09.888267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:09.888983 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:09.906912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.907385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:09.908248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:09.908700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:10.034708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:10.044008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-606523c2-9921-4861-9cde-a0faa8b2a4aa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.287056 Jul 26 15:08:10.044558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 231/477] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:09 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:10.089701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:10.102081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e828709c-9ca0-49e5-abad-dba43ae710f0 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.219780 Jul 26 15:08:10.103307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 247/478] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:09 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:10.897806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:10.898584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:10.906890 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:10.907418 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:10.908271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:10.908722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.067869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:11.072091 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:11.072805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:11.079768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:11.080433 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.080561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-af596d97-3553-44ce-b1bb-8c355166fb33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.189458 Jul 26 15:08:11.081477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:11.082090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.088914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 232/479] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:10 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:11.127876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:11.129342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:11.133368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:11.148847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:11.149311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.150513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:11.153247 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.283196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:11.295448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e7ceea42-4c2e-4302-83a1-95894254a4e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.230557 Jul 26 15:08:11.314474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 248/480] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:11 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:11.369835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:11.379503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-43f563c6-5a80-4ff4-a5b7-9b9a7ebfcbf8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.255937 Jul 26 15:08:11.379968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 233/481] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:11 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:12.104684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:12.105953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:12.114748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.115334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.116663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.117107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.141378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:12.292381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:12.300237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ca2dc7e3-8758-4fe6-b91f-c21511354897 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.199530 Jul 26 15:08:12.301812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 249/482] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:12 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:12.319781 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:12.325958 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:12.327894 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.328348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.329301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.329902 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.402375 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:12.403366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:12.409755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.410231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.411159 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.411802 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.495190 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:12.506438 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-60adacd8-c675-40ec-9538-9369eaf86fab tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.190824 Jul 26 15:08:12.507631 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 234/483] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:12 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:12.570974 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:12.581051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0d8c0da2-1ca2-490d-8697-cc3084ecc68c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.183364 Jul 26 15:08:12.581922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 250/484] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:12 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:13.324947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:13.325959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:13.327536 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=4 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:13.334028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.334470 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.335450 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.335910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.478769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:13.487147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d51989aa-f34b-463e-8a19-e94b61209af9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.165972 Jul 26 15:08:13.487755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 235/485] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:13 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:13.527932 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:13.529232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:13.536471 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.536908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.537936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.538426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.602606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:13.603690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:13.613685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.614992 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.616242 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.617188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.694096 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:13.702700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c3216d62-94f4-40ca-ad3b-d2a58ba2371c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.178428 Jul 26 15:08:13.703806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 251/486] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:13 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:13.799890 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:13.810713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f9eeebc4-eadb-4815-b007-52e691655d9a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.212057 Jul 26 15:08:13.823487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 236/487] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:13 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:14.511139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:14.511788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:14.518465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.518917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.520418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.520886 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.638013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-95f5dbb3-63b3-4f76-82b6-fa2340c2db9a req-1e344c0f-8e82-4263-8035-e2e3903af72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530f5891-c2f5-4273-8ef0-c733ef667dc3", "name": "network-vif-plugged", "status": "completed", "tag": "4f4c8eee-d209-4040-b613-9be1c6f38ffd"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:14.653628 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-95f5dbb3-63b3-4f76-82b6-fa2340c2db9a req-1e344c0f-8e82-4263-8035-e2e3903af72d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.654167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-95f5dbb3-63b3-4f76-82b6-fa2340c2db9a req-1e344c0f-8e82-4263-8035-e2e3903af72d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.667815 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-95f5dbb3-63b3-4f76-82b6-fa2340c2db9a req-1e344c0f-8e82-4263-8035-e2e3903af72d service nova] Creating event network-vif-plugged:4f4c8eee-d209-4040-b613-9be1c6f38ffd for instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 on hv-cinder-85066 Jul 26 15:08:14.674467 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-95f5dbb3-63b3-4f76-82b6-fa2340c2db9a req-1e344c0f-8e82-4263-8035-e2e3903af72d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041690 Jul 26 15:08:14.675315 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 237/488] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:14.695163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:14.704666 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-061b73c0-3a5a-4568-a4e5-80973b1766a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.197523 Jul 26 15:08:14.705918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 252/489] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:14 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:14.738155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:14.744630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:14.748079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.748711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.749629 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.750322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.835367 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:14.836095 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:14.843009 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.843486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.844266 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.844884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:15.075321 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:15.084290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ccbf3574-756c-45a4-8994-9d0314ecb036 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1368 microversion: 2.1 time: 0.350837 Jul 26 15:08:15.086779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 238/490] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:14 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:15.089230 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:15.101617 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5010bec9-80c9-400b-9440-d6f8b7da8e92 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.270675 Jul 26 15:08:15.102733 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 253/491] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:14 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:15.731495 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:15.732127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:15.743934 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:15.744647 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:15.745894 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:15.746331 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:15.915924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:15.925186 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1526a813-3336-467a-bd88-f5a1292d2d76 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.197420 Jul 26 15:08:15.935847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 239/492] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:15 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:16.112810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:16.114303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:16.121731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.128126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:16.129017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:16.131911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.132948 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.136878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.137118 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.141991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.142810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.143889 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.352606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:16.361802 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f3f505fa-af28-4354-a4ce-bc2d469c5d96 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.237493 Jul 26 15:08:16.362743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 240/493] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:16 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:16.363216 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:16.372883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0d614fab-3008-44fd-bce6-78de3a2b36b1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1559 microversion: 2.1 time: 0.269480 Jul 26 15:08:16.373664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 254/494] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:16 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1559 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:16.395506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:16.396254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:16.403298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.403787 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.404919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.405520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.499400 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4d5b9433-b37d-4145-a405-798ce2c943e2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108529 Jul 26 15:08:16.500235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 241/495] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:08:16 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:16.948297 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:16.948901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:16.962164 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.962880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:16.963706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:16.964149 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:17.136861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:17.148732 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c860b45c-c4bc-4a82-94c1-d22c464c3e3f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.204901 Jul 26 15:08:17.149686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 255/496] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:16 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:17.384911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:17.385531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:17.393463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:17.394292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:17.395328 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:17.395977 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:17.649834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:17.657578 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a049ae06-0eee-41cd-acce-8dd18d588fe8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.276554 Jul 26 15:08:17.658152 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 242/497] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:17 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:18.182258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-13087fb0-fa30-45b0-8d4b-443d870f4b8f req-93a2718f-fda8-45c3-a040-4a9076973f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22db4394-5de8-471c-8738-b0484e5f7032", "tag": "58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:18.195240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:18.196282 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:18.203256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-13087fb0-fa30-45b0-8d4b-443d870f4b8f req-93a2718f-fda8-45c3-a040-4a9076973f84 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:18.209590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-13087fb0-fa30-45b0-8d4b-443d870f4b8f req-93a2718f-fda8-45c3-a040-4a9076973f84 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:18.209767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:18.209767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:18.209767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:18.209767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:18.224537 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-13087fb0-fa30-45b0-8d4b-443d870f4b8f req-93a2718f-fda8-45c3-a040-4a9076973f84 service nova] Creating event network-changed:58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a for instance 22db4394-5de8-471c-8738-b0484e5f7032 on hv-cinder-85066 Jul 26 15:08:18.231415 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-13087fb0-fa30-45b0-8d4b-443d870f4b8f req-93a2718f-fda8-45c3-a040-4a9076973f84 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052270 Jul 26 15:08:18.232649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 256/498] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:18.425997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:18.437128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-302da33c-54fb-4bf7-b400-24bd5ed2db46 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.251972 Jul 26 15:08:18.437710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 243/499] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:18 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:18.685205 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:18.686784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:18.699694 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:18.700299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:18.701401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:18.702058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:18.891518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:18.905351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0a6e4d9f-1a83-4aed-91ef-96b2aec474f9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.227290 Jul 26 15:08:18.917093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 257/500] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:18 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:19.462895 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:19.463692 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:19.470822 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.472424 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:19.473546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.474130 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:19.478982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:19.761392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:19.774621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cd089236-22ea-4df6-a648-4159a67405d7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.315691 Jul 26 15:08:19.775203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 244/501] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:19 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:19.931154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:19.932060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:19.939742 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.940069 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:19.941703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.942552 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:20.135057 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:20.144202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9b5c3ca7-d946-4c6b-9539-dd8ef5a7b075 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.219143 Jul 26 15:08:20.145591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 258/502] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:19 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:20.801556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:20.802212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:20.819305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:20.819792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:20.820603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:20.821042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:21.074772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:21.084262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2fef0ce2-5826-436e-8478-cf70caa18872 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.287864 Jul 26 15:08:21.085363 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 245/503] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:20 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:21.168936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:21.169555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:21.177610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:21.178309 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:21.179116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:21.179726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:21.366420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:21.376893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-18bd8bad-1d3b-4d09-bd9f-8fc1cd394380 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.212547 Jul 26 15:08:21.377778 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 259/504] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:21 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:22.108640 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:22.109620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:22.124596 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:22.125051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:22.127556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:22.127556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:22.291028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:22.298730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-746a4b1d-3fcd-432e-ae7f-136bc314d742 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.194838 Jul 26 15:08:22.299301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 246/505] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:22 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:22.414413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:22.415125 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:22.422104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:22.422550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:22.429670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:22.429670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:22.573925 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:22.583881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a3f9daa6-4b3d-4bb3-bde7-b6540ed8ad55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.174408 Jul 26 15:08:22.584628 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 260/506] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:22 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:23.321912 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:23.322698 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:23.329335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:23.329779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:23.330645 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:23.331076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:23.475993 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:23.483584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-891703c3-d68b-44a6-bf8c-fd2f989b13a9 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.167587 Jul 26 15:08:23.484155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 247/507] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:23 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:23.607697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:23.608566 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:23.611060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=79 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:23.616790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:23.617240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:23.618025 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:23.618741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:23.773286 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:23.782905 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fa51c56c-69fe-48b7-ad9e-7aadd1fd5cb5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.179928 Jul 26 15:08:23.783867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 261/508] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:23 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:24.507838 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:24.508560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:24.516577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:24.517006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:24.517784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:24.518222 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:24.682953 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:24.691586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8a63b989-e41c-40d8-885a-c7b7b34db865 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1371 microversion: 2.1 time: 0.187623 Jul 26 15:08:24.692161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 248/509] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:24 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:24.808188 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:24.809055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:24.816635 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:24.817369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:24.818240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:24.818686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:24.959268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:24.968277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-268b4485-68de-4229-9906-a5a4ea92650f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1724 microversion: 2.1 time: 0.164031 Jul 26 15:08:24.969503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 262/510] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:24 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:25.714660 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:25.715279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:25.722521 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:25.723048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:25.723798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:25.724241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:25.880028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:25.888009 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-200d4155-c78d-42e7-9eab-9da6ac2fa474 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1566 microversion: 2.1 time: 0.178543 Jul 26 15:08:25.891247 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 249/511] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:25 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:25.910337 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:25.910850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:25.917626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:25.918077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:25.918874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:25.919312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:25.990589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:25.991201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:26.000568 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.002161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.003429 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.005221 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2aaae966-f5c2-4e48-9cf1-a4d3e6cf007f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099467 Jul 26 15:08:26.005828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 263/512] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:08:25 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:26.007313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.305478 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:26.320655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9ed3a4af-a8cf-4c82-83da-f8703edb4056 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1701 microversion: 2.1 time: 0.334085 Jul 26 15:08:26.321910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 250/513] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:25 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1701 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:26.351229 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c357e86b-c295-4b9d-8d53-56009abf857f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:26.357751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c357e86b-c295-4b9d-8d53-56009abf857f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.358199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c357e86b-c295-4b9d-8d53-56009abf857f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.383099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c357e86b-c295-4b9d-8d53-56009abf857f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Going to try to start instance {{(pid=130762) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 15:08:26.588560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c357e86b-c295-4b9d-8d53-56009abf857f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.241123 Jul 26 15:08:26.589169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 264/514] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:08:26 2022] POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:26.597820 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:26.598426 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:26.609874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.610341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.611161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.611649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.840361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:26.849777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6a813b7c-ab8e-4397-9d88-110494a4b776 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1710 microversion: 2.1 time: 0.255996 Jul 26 15:08:26.850968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 251/515] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:26 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1710 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:27.465578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-58e8d0bb-e6ff-4951-bbca-fa2479fcdb76 req-8fc4e74d-5b67-418e-af8e-76632fa056be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530f5891-c2f5-4273-8ef0-c733ef667dc3", "tag": "4f4c8eee-d209-4040-b613-9be1c6f38ffd"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:27.477131 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-58e8d0bb-e6ff-4951-bbca-fa2479fcdb76 req-8fc4e74d-5b67-418e-af8e-76632fa056be service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:27.477632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-58e8d0bb-e6ff-4951-bbca-fa2479fcdb76 req-8fc4e74d-5b67-418e-af8e-76632fa056be service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:27.491146 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-58e8d0bb-e6ff-4951-bbca-fa2479fcdb76 req-8fc4e74d-5b67-418e-af8e-76632fa056be service nova] Creating event network-changed:4f4c8eee-d209-4040-b613-9be1c6f38ffd for instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 on hv-cinder-85066 Jul 26 15:08:27.498097 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-58e8d0bb-e6ff-4951-bbca-fa2479fcdb76 req-8fc4e74d-5b67-418e-af8e-76632fa056be service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037068 Jul 26 15:08:27.499039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 265/516] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:27.872729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:27.873404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:27.881646 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:27.882094 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:27.882886 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:27.883318 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:28.038697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:28.047554 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c6402db3-ed7c-4c0b-ab7b-d6584d942e98 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1710 microversion: 2.1 time: 0.179039 Jul 26 15:08:28.048143 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 252/517] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:27 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:29.084751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:29.085702 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:29.093472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:29.093912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:29.094678 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:29.095105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:29.240098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:29.244155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:29.249321 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-12542ac5-ab4e-472e-85ee-42f7fb571f91 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1710 microversion: 2.1 time: 0.170387 Jul 26 15:08:29.256288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 266/518] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:29 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:30.274770 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:30.275764 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:30.283122 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:30.283640 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:30.284805 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:30.285413 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:30.433113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:30.442306 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-84ff8b83-04d5-4881-82fb-8e31562aa864 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1710 microversion: 2.1 time: 0.174479 Jul 26 15:08:30.443367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 253/519] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:30 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1710 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:31.464535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:31.465051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:31.472678 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:31.473139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:31.473931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:31.474357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:31.620127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:31.630328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5ec9b96d-1627-4e6a-ab7c-ac407024bc25 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1710 microversion: 2.1 time: 0.169901 Jul 26 15:08:31.631000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 267/520] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:31 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:32.653462 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:32.654010 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:32.661486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:32.661926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:32.662684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:32.663118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:32.816238 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:32.824648 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6e5a0ec1-9391-4d2b-8ac0-7c013cd5e00d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1714 microversion: 2.1 time: 0.175201 Jul 26 15:08:32.825225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 254/521] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:32 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:33.747872 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:33.751219 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:33.755947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:33.756403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:33.757294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:33.757606 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:33.887867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lazy-loading 'services' on Instance uuid 43a050fd-1d02-47df-b37b-17f496480a78 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:08:34.148352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b5b03454-a1db-4753-94c7-be6d3196e547 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "DELETE /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78/os-volume_attachments/738f9677-1ffd-405b-8893-72f4c560e84b" status: 202 len: 0 microversion: 2.1 time: 0.404565 Jul 26 15:08:34.148939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 268/522] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:08:33 2022] DELETE /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78/os-volume_attachments/738f9677-1ffd-405b-8893-72f4c560e84b => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:46.301411 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-370228536", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:46.314031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=43 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:46.315069 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=64 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:46.368850 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] validate_networks() for None {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:08:46.911011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:08:46.911444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:08:46.911946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:08:46.912360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:08:46.912797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:08:46.922004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:46.922482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:46.923324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:46.923799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:46.941978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Getting quotas for project 484282e33cd64579b59888ba08ef08c5. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:08:46.946188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Getting quotas for user aafb57f34153410783daed91152fa43b and project 484282e33cd64579b59888ba08ef08c5. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:08:46.958297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:08:46.960594 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:08:47.150231 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-847e6541-1138-4336-b367-53cce44290cf tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854258 Jul 26 15:08:47.150772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 255/523] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:08:47.160179 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=15 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:47.162530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:47.167293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f5c24fb5-185e-41fe-92f7-c1cab138a55c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:47.168204 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f5c24fb5-185e-41fe-92f7-c1cab138a55c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:47.232665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f5c24fb5-185e-41fe-92f7-c1cab138a55c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:47.241312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f5c24fb5-185e-41fe-92f7-c1cab138a55c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1214 microversion: 2.1 time: 0.083053 Jul 26 15:08:47.242288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 269/524] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:47 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:48.272827 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-dee568ae-e239-4580-9ae5-49511e8afe66 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:48.274090 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-dee568ae-e239-4580-9ae5-49511e8afe66 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:48.354784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-dee568ae-e239-4580-9ae5-49511e8afe66 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:48.364917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-dee568ae-e239-4580-9ae5-49511e8afe66 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1214 microversion: 2.1 time: 0.098225 Jul 26 15:08:48.366358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 256/525] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:48 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:49.389340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:49.389953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:49.399753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:49.400200 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:49.401231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:49.401755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:49.498293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:49.516001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5a44d519-e1e1-4346-80d2-4995a16e4451 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.131217 Jul 26 15:08:49.517633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 270/526] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:49 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:50.540264 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:50.541264 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:50.548253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.549601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.550463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.551082 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.623089 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:50.631886 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-41beb014-3ef9-4e42-beb9-e577079b7630 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.095352 Jul 26 15:08:50.632529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 257/527] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:50 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:51.659707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:51.659707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:51.661579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:51.662285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:51.663078 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:51.663533 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:51.730094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:51.738403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8d6c8c81-589a-4f98-adf3-f0abb0f2503f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.088235 Jul 26 15:08:51.739305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 271/528] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:51 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:52.759697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:52.760303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:52.766913 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:52.767353 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:52.768214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:52.768821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:52.835078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:52.843252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9bd22c5b-04a8-4bee-8fca-cc7a8a2a9031 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.087371 Jul 26 15:08:52.844196 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 258/529] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:52 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:53.864300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:53.864852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:53.871704 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:53.872176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:53.873299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:53.873770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:53.937926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:53.946338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-be3b510e-9402-4674-915a-9226712bb4a2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.085974 Jul 26 15:08:53.946908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 272/530] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:53 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:54.967566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:54.968148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:54.974731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:54.975181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:54.975971 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:54.976404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:55.037662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:55.045077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c5d2f9e1-266a-4546-8bf5-803d5d5aa0c9 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.081772 Jul 26 15:08:55.045669 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 259/531] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:54 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:56.066820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:56.067448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:56.074008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:56.074448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:56.075208 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:56.075665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:56.136946 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:56.144555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9143c269-2c2c-4f3d-a078-61a2b678ef11 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.082277 Jul 26 15:08:56.145118 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 273/532] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:56 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:57.165383 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:57.166025 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:57.168406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:57.173759 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:57.174758 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:57.175626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:57.176075 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:57.249590 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:57.256182 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-206fd343-092a-4973-8ccd-d133dd0bca05 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1218 microversion: 2.1 time: 0.094785 Jul 26 15:08:57.268561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 260/533] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:57 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:58.036107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:58.036712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:58.039010 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:58.044478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.044923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.045709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.046141 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.077777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:08:58.282976 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:58.283872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:58.291456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.291931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.292711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.293142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.361729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=8 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:58.371406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:58.385381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0cafef7a-468d-460e-96a3-0687c1289e5e tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1266 microversion: 2.1 time: 0.106554 Jul 26 15:08:58.386467 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 261/534] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:58 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:58.441686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8b464c82-ace3-484b-b0fa-22d01d54e94b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "DELETE /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 204 len: 0 microversion: 2.1 time: 0.410090 Jul 26 15:08:58.442269 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 274/535] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:08:58 2022] DELETE /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:08:58.450996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:58.451644 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:58.458599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.459049 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.459919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.460362 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.615100 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:58.623767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-63cbe756-6470-4888-8aa2-e410aa954062 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1514 microversion: 2.1 time: 0.176804 Jul 26 15:08:58.624742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 262/536] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:58 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:58.935814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1219554988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-158600999", "security_groups": [{"name": "tempest-secgroup-smoke-254545217"}], "networks": [{"uuid": "a84bb2f5-ac0b-4a3f-92cc-0d5d8fc6ff9a"}], "block_device_mapping_v2": [{"uuid": "aa5461ac-f54c-4fd1-977f-7a0a058fc82e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:59.059486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] validate_networks() for [('a84bb2f5-ac0b-4a3f-92cc-0d5d8fc6ff9a', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:08:59.410353 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.411043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:59.418575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.419032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.420065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.420531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.475771 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:08:59.480804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:08:59.480804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:08:59.480804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:08:59.480804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:08:59.488211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.488688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.489619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.489952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.490212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:59.498381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6fdc502b-87f7-4fdc-a9e6-3f6dd43c7cc0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1284 microversion: 2.1 time: 0.092629 Jul 26 15:08:59.498963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 263/537] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:59 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:59.513967 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Getting quotas for project a9f0ab2fc6e64eada5f55a0f0a835073. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:08:59.518949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Getting quotas for user 2fc5fd88556145fda1fb0067d5e9adcc and project a9f0ab2fc6e64eada5f55a0f0a835073. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:08:59.578795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:08:59.582217 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa5461ac-f54c-4fd1-977f-7a0a058fc82e',volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:08:59.647319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.647960 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:59.653996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.654442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.655216 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.655679 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.798043 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:59.807138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-28759d50-ec35-4b93-a2c6-b6dc18c3ea46 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1514 microversion: 2.1 time: 0.163759 Jul 26 15:08:59.808329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 264/538] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:59 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:00.084618 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9611ca75-9252-4680-a2ee-27a7a29ed61f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.152195 Jul 26 15:09:00.087092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 275/539] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:08:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:09:00.098443 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-665bc34d-b877-4c08-95ca-e234343bb477 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:00.099152 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-665bc34d-b877-4c08-95ca-e234343bb477 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:00.161761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-665bc34d-b877-4c08-95ca-e234343bb477 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:00.169948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-665bc34d-b877-4c08-95ca-e234343bb477 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1088 microversion: 2.1 time: 0.076754 Jul 26 15:09:00.171093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 265/540] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:00 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:00.520672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:00.521438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:00.527900 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:00.528356 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:00.529176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:00.529613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:00.592896 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:00.601326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-86e42adb-2e25-4d7d-b62e-047cee53830f tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1284 microversion: 2.1 time: 0.084990 Jul 26 15:09:00.605183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 276/541] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:00 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:00.831152 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:00.832413 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:00.839487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:00.839943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:00.840744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:00.841182 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:00.991344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:01.000981 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5ac4b0ab-4204-4d22-8b58-39e264428d8b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1514 microversion: 2.1 time: 0.175098 Jul 26 15:09:01.002581 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 266/542] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:00 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:01.192701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e4acc220-7f7a-4088-be14-befafcd9d726 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:01.193328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e4acc220-7f7a-4088-be14-befafcd9d726 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:01.255308 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e4acc220-7f7a-4088-be14-befafcd9d726 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:01.260381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e4acc220-7f7a-4088-be14-befafcd9d726 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1088 microversion: 2.1 time: 0.071832 Jul 26 15:09:01.261296 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 277/543] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:01 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:01.622607 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:01.623084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:01.630467 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:01.630866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:01.631693 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:01.632133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:01.699990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:01.708675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3274e967-2891-40d6-8d6a-6162f49a66ed tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1272 microversion: 2.1 time: 0.090294 Jul 26 15:09:01.712329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 267/544] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:01 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:02.023665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:02.024756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:02.037167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.039071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.045502 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.045502 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.287705 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:02.287705 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:02.294003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.294456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.295557 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.296205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.323236 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:02.344113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1b0703f1-cb1d-4c57-bca9-7706a6bdb318 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1514 microversion: 2.1 time: 0.324061 Jul 26 15:09:02.345929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 278/545] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:02 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:02.425965 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:02.436481 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ab730fb0-c280-4c9d-8b27-e0c95f72ef7b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1130 microversion: 2.1 time: 0.156914 Jul 26 15:09:02.437055 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 268/546] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:02 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1130 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:02.702555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-84908fcd-34ff-43ac-83d1-c4073c45334b req-a6e2dcb0-f1a5-47be-a649-2a7031f5945a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a050fd-1d02-47df-b37b-17f496480a78", "name": "network-vif-deleted", "tag": "642f8bc5-5d97-4c38-a9b4-6db449ae030e"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:02.713615 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-84908fcd-34ff-43ac-83d1-c4073c45334b req-a6e2dcb0-f1a5-47be-a649-2a7031f5945a service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.714063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-84908fcd-34ff-43ac-83d1-c4073c45334b req-a6e2dcb0-f1a5-47be-a649-2a7031f5945a service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.727104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-84908fcd-34ff-43ac-83d1-c4073c45334b req-a6e2dcb0-f1a5-47be-a649-2a7031f5945a service nova] Creating event network-vif-deleted:642f8bc5-5d97-4c38-a9b4-6db449ae030e for instance 43a050fd-1d02-47df-b37b-17f496480a78 on hv-cinder-85066 Jul 26 15:09:02.731708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:02.732442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:02.732588 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-84908fcd-34ff-43ac-83d1-c4073c45334b req-a6e2dcb0-f1a5-47be-a649-2a7031f5945a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033918 Jul 26 15:09:02.733189 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 279/547] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:02.740898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.741379 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.742213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.742650 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.919153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:02.927274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c83d0a8e-c1a8-4dd0-bdf6-e5c3f28ec673 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.201108 Jul 26 15:09:02.928022 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 269/548] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:02 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:03.368415 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:03.369898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:03.377295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.378071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.378865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.379294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.458730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.459173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.459661 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lazy-loading 'fault' on Instance uuid 43a050fd-1d02-47df-b37b-17f496480a78 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:03.462487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:03.463842 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:03.474289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.475001 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.476743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.477183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.561811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:03.581159 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a754762c-6b34-4ef4-8f83-5dbfce73c5ea tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 200 len: 1309 microversion: 2.1 time: 0.217132 Jul 26 15:09:03.586756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:03.594191 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 280/549] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:03 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:03.596067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-17124181-29d6-42d3-b07f-4bca4c837d68 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1194 microversion: 2.1 time: 0.137844 Jul 26 15:09:03.598670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 270/550] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:03 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:03.803087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-73ea5864-4359-4fd3-a0ff-d0aec3a53953 req-1de4d93c-ed83-4af2-9ff6-989a6ea0ba73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cac7a938-7f02-4e37-b392-bfd28ec5c72a", "tag": "e638e0cf-c4c9-4836-b1a0-4cc190f7394c"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:03.819507 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-73ea5864-4359-4fd3-a0ff-d0aec3a53953 req-1de4d93c-ed83-4af2-9ff6-989a6ea0ba73 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.820290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-73ea5864-4359-4fd3-a0ff-d0aec3a53953 req-1de4d93c-ed83-4af2-9ff6-989a6ea0ba73 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.834663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-73ea5864-4359-4fd3-a0ff-d0aec3a53953 req-1de4d93c-ed83-4af2-9ff6-989a6ea0ba73 service nova] Creating event network-changed:e638e0cf-c4c9-4836-b1a0-4cc190f7394c for instance cac7a938-7f02-4e37-b392-bfd28ec5c72a on hv-cinder-85066 Jul 26 15:09:03.842664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-73ea5864-4359-4fd3-a0ff-d0aec3a53953 req-1de4d93c-ed83-4af2-9ff6-989a6ea0ba73 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058599 Jul 26 15:09:03.843278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 281/551] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:03.949762 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:03.954132 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:03.965736 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.966301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.967125 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.967590 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.235197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:04.245144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6ac626ef-ed94-4c8f-87a6-d63315d5b818 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.299602 Jul 26 15:09:04.259615 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 271/552] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:03 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:04.614296 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:04.625421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: 43a050fd-1d02-47df-b37b-17f496480a78] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:04.625630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:04.625630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:04.631157 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:04.635329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:04.637188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.638514 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:04.638680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.639442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.641037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:04.641627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.671057 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] HTTP exception thrown: Instance 43a050fd-1d02-47df-b37b-17f496480a78 could not be found. Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Request method failure captured: Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 HTTP/1.1 Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AMH1GlbaOtnG2E4LL-YxDaeRUZ3Y70oRNL9_0I5K0LUPGhblxsCKte6a0ZyNUubrI_MeCjDPeTamBJie_3eFC5BF4c5hIaeVuSs_7p6UOEqkbNNtcDoFGo5HUNsGlT4gPHJ0l2tuFka8SlzDV-pSsDfBZ_WrLV8Tb0Al5PEaeeukII Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 87391d9e4bdc48209437f1d786f376c1 Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1062418878 Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:09:04.674079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesSnapshotTestJSON-1062418878 Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 87391d9e4bdc48209437f1d786f376c1 Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1062418878 Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesSnapshotTestJSON-1062418878-project Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 9cb5ce208a2442c2b9b39ac92da6a78e Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesSnapshotTestJSON-1062418878-project Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 43a050fd-1d02-47df-b37b-17f496480a78 could not be found. Jul 26 15:09:04.675721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '43a050fd-1d02-47df-b37b-17f496480a78'} Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a050fd-1d02-47df-b37b-17f496480a78 could not be found. Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:04.676638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a050fd-1d02-47df-b37b-17f496480a78 could not be found. Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a050fd-1d02-47df-b37b-17f496480a78 could not be found. Jul 26 15:09:04.678098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:04.680573 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Returning 404 to user: Instance 43a050fd-1d02-47df-b37b-17f496480a78 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:04.682809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-54ee2c74-4e0a-4381-9545-3f15f71b7b21 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78" status: 404 len: 111 microversion: 2.1 time: 0.079058 Jul 26 15:09:04.683989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 282/553] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:04 2022] GET /compute/v2.1/servers/43a050fd-1d02-47df-b37b-17f496480a78 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:09:04.803378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:04.803378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-701fdea3-2e00-4f5a-bb3b-0c5b03f2c1fe tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1204 microversion: 2.1 time: 0.183752 Jul 26 15:09:04.803378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 272/554] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:04 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1204 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:05.268584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:05.269597 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:05.279439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:05.279439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:05.279911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:05.280586 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:05.481784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:05.491133 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-22645907-a365-41fb-adea-27afe3bc1963 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.228623 Jul 26 15:09:05.492099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 283/555] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:05 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:05.821525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:05.822136 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:05.829207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:05.830217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:05.831350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:05.832037 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:05.973465 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:05.982802 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-64a8f6c2-6ce8-4aed-a323-235e62ab9eec tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1271 microversion: 2.1 time: 0.165205 Jul 26 15:09:05.983393 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 273/556] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:05 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:06.513532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:06.514165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:06.522121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:06.522607 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:06.523426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:06.523903 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:06.687844 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:06.700932 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fcef44bb-cd74-4a0a-853a-cd3cc015cf8a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.191521 Jul 26 15:09:06.702917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 284/557] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:06 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:07.005317 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:07.005937 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:07.027604 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:07.028069 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:07.028856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:07.029320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:07.033867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:07.213334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:07.222738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f14f356c-16ec-4ada-a650-222211fd0373 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1271 microversion: 2.1 time: 0.221863 Jul 26 15:09:07.223607 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 274/558] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:06 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:07.737476 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:07.737476 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:07.750451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:07.752188 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:07.753904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:07.754938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:07.926051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:07.936736 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-66df2a17-8ae3-4082-ad98-735bb7688cbe tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.210167 Jul 26 15:09:07.938231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 285/559] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:07 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:08.255167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:08.259825 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:08.273638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:08.274102 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:08.274915 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:08.275378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:08.556695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:08.562068 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ff2b9619-6dc1-4347-b039-7f3ceeab059b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1271 microversion: 2.1 time: 0.313146 Jul 26 15:09:08.562729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 275/560] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:08 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:08.964577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:08.965364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:08.973092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:08.973544 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:08.974333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:08.974880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:09.133798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:09.142827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-52afba22-8c09-42bb-b1fa-0302930feffa tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.182198 Jul 26 15:09:09.149599 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 286/561] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:08 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:09.584642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:09.585493 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:09.592430 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:09.592807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:09.593624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:09.594063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:09.900258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:09.911584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ddc28a9b-96ae-4104-9d10-263321d86503 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.331181 Jul 26 15:09:09.915656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 276/562] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:09 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:10.164653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:10.166038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:10.168314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:10.178372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.178831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:10.180071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.180561 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:10.287148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-38f4e431-d114-4e93-a9e2-e588d845ccfd req-684015d9-bb9a-464b-9815-33fe6e385f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:10.300891 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:10.318798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-38f4e431-d114-4e93-a9e2-e588d845ccfd req-684015d9-bb9a-464b-9815-33fe6e385f6b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.319792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-38f4e431-d114-4e93-a9e2-e588d845ccfd req-684015d9-bb9a-464b-9815-33fe6e385f6b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:10.351795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-38f4e431-d114-4e93-a9e2-e588d845ccfd req-684015d9-bb9a-464b-9815-33fe6e385f6b service nova] Creating event network-changed:79dc17dd-0f41-4a9f-9307-9de726b3d06e for instance 440d23f7-96c6-46ce-b2ff-147c4070509b on hv-cinder-85066 Jul 26 15:09:10.359403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-38f4e431-d114-4e93-a9e2-e588d845ccfd req-684015d9-bb9a-464b-9815-33fe6e385f6b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080211 Jul 26 15:09:10.360321 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 277/563] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:10.518105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:10.530489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b27796b7-1693-4420-8c8b-486031877075 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.370121 Jul 26 15:09:10.535436 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 287/564] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:10 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:10.939076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:10.940356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:10.950722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.951378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:10.952853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.953543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:11.162740 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:11.172138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c14825a4-1162-4946-a696-e500a198f5c7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.238266 Jul 26 15:09:11.172719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 278/565] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:10 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:11.564897 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:11.567873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:11.585885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=8 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:11.589036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:11.589695 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:11.590814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:11.591681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:11.599914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:11.791528 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:11.805247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e7f09f26-6c4a-494c-a6a6-623af66d1cc6 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.251264 Jul 26 15:09:11.806801 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 288/566] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:11 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:12.194443 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:12.195326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:12.202401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:12.202860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:12.203773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:12.204840 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:12.441093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:12.450051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d6e6bb7e-ac8e-49e1-a55d-e446b5dfb7f7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.259547 Jul 26 15:09:12.451307 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 279/567] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:12 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:12.843228 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:12.844146 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:12.852777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:12.853234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:12.854016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:12.854637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:13.006987 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:13.015198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1961eb48-8de3-4d7a-aa1e-ff6750600687 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.175969 Jul 26 15:09:13.016168 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 289/568] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:12 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:13.473425 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:13.473964 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:13.481255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:13.481722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:13.482532 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:13.483004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:13.663609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:13.672149 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-431bb64a-318a-4b2f-9878-53303b109370 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.203082 Jul 26 15:09:13.673704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 280/569] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:13 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:14.037413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:14.038193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:14.049777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:14.049777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:14.049777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:14.049777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:14.279151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:14.288003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e3129167-91c9-4f67-ab44-239ec5274bb4 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.254407 Jul 26 15:09:14.289012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 290/570] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:14 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:14.696727 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:14.697693 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:14.707562 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:14.708032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:14.709251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:14.710162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:14.899780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:14.912697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-23d8e1b0-d7ec-44dd-8f7f-23334fef8b8e tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.221105 Jul 26 15:09:14.913639 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 281/571] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:14 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:15.311543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:15.312243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:15.323211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.325323 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.327362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.329857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.593443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:15.605792 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6407daca-0d17-48d4-a577-37225b81316a tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.298089 Jul 26 15:09:15.625583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 291/572] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:15 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:15.776358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1407400134", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "networks": [{"uuid": "d851ed92-9c90-461b-be87-9a00db72d9c3"}]}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:15.853414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] validate_networks() for [('d851ed92-9c90-461b-be87-9a00db72d9c3', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:09:15.935199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:15.935938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:15.947651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.950589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.951923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.955661 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.461441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:16.479748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c0f14596-461f-4ce7-86d2-b8df62d8ce24 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.548533 Jul 26 15:09:16.483016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 292/573] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:15 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:16.493030 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-a0d50f8f-30a1-4d33-abc1-cf0b9934d46c req-520ffce2-ac85-48ee-b41d-4b144f8f5c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac7a938-7f02-4e37-b392-bfd28ec5c72a", "name": "network-vif-plugged", "status": "completed", "tag": "e638e0cf-c4c9-4836-b1a0-4cc190f7394c"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:16.508713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-a0d50f8f-30a1-4d33-abc1-cf0b9934d46c req-520ffce2-ac85-48ee-b41d-4b144f8f5c08 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:16.509852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-a0d50f8f-30a1-4d33-abc1-cf0b9934d46c req-520ffce2-ac85-48ee-b41d-4b144f8f5c08 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.536251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:09:16.536708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:09:16.537223 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:09:16.537655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:09:16.538079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:09:16.544755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:16.547435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-a0d50f8f-30a1-4d33-abc1-cf0b9934d46c req-520ffce2-ac85-48ee-b41d-4b144f8f5c08 service nova] Creating event network-vif-plugged:e638e0cf-c4c9-4836-b1a0-4cc190f7394c for instance cac7a938-7f02-4e37-b392-bfd28ec5c72a on hv-cinder-85066 Jul 26 15:09:16.554427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:16.554652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-a0d50f8f-30a1-4d33-abc1-cf0b9934d46c req-520ffce2-ac85-48ee-b41d-4b144f8f5c08 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068823 Jul 26 15:09:16.555246 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.555583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 293/574] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:16.556496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:16.556935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.583446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Getting quotas for project 87391d9e4bdc48209437f1d786f376c1. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:09:16.590306 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Getting quotas for user 9cb5ce208a2442c2b9b39ac92da6a78e and project 87391d9e4bdc48209437f1d786f376c1. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:09:16.611396 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:09:16.615011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:09:16.629050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:16.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:16.637234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:16.638382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.640001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:16.640746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.781302 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-154527f5-85cd-4fdc-aa95-a769c8865499 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015486 Jul 26 15:09:16.783172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 282/575] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:09:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:09:16.804506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-45400bf4-4206-4a45-b2fe-49d167b54c7a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:16.807292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-45400bf4-4206-4a45-b2fe-49d167b54c7a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:16.937445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-45400bf4-4206-4a45-b2fe-49d167b54c7a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:16.957294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-45400bf4-4206-4a45-b2fe-49d167b54c7a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1219 microversion: 2.1 time: 0.163206 Jul 26 15:09:16.958272 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 283/576] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:16 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:17.005630 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:17.014176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-dfc831d1-a826-46e0-afca-e5c55b27cad3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.391054 Jul 26 15:09:17.014730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 294/577] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:16 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:17.507555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:17.508482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:17.515195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:17.515677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:17.517023 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:17.517652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:17.681341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:17.692326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-173b8e18-5999-472d-a307-02f2c4f2d9c1 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.189217 Jul 26 15:09:17.692885 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 284/578] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:17 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:17.981420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4544788a-d68c-4dad-b552-3d5e04838052 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:17.983983 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4544788a-d68c-4dad-b552-3d5e04838052 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:18.041029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:18.042262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:18.052529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:18.053365 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:18.054382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:18.055113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:18.067716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4544788a-d68c-4dad-b552-3d5e04838052 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:18.074121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4544788a-d68c-4dad-b552-3d5e04838052 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1219 microversion: 2.1 time: 0.097507 Jul 26 15:09:18.089836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 295/579] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:17 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:18.244039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:18.254153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-519e9d82-2301-4aaf-8012-850b3133075c tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.217022 Jul 26 15:09:18.256659 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 285/580] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:18 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:18.718815 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:18.720551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:18.728289 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:18.728917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:18.729826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:18.731265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:18.971310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:18.980487 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e0bc7f3b-2172-44df-a816-1fba0a1a93cf tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.265556 Jul 26 15:09:18.981672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 296/581] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:18 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:19.102187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:19.103031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:19.114510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:19.115219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:19.116440 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:19.117108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:19.197432 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:19.207690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-333c4595-f378-403a-a3f5-fe9003721fe3 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1223 microversion: 2.1 time: 0.112691 Jul 26 15:09:19.208420 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 286/582] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:19 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:19.284692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:19.285836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:19.296741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:19.297857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:19.299701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:19.300983 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:19.550761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:19.559380 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b16d4f25-abe2-4cb6-a40d-d3ac7f8fc787 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1314 microversion: 2.1 time: 0.283758 Jul 26 15:09:19.560005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 297/583] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:19 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:20.002878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:20.003670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:20.014486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:20.015120 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:20.016179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:20.017841 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:20.197063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:20.207793 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4a7da166-23b9-4c9e-a4b3-50c71e972a5c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.209321 Jul 26 15:09:20.208865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 287/584] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:19 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:20.231135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:20.232523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:20.234675 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:20.241890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:20.242917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:20.244042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:20.246049 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:20.395075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:20.405378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fc0ba4fd-d320-4778-92b6-eea64a299042 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1271 microversion: 2.1 time: 0.177571 Jul 26 15:09:20.405562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 298/585] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:20 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:20.580668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:20.581347 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:20.588656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:20.589628 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:20.591086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:20.591778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:20.950339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:20.961046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-159df098-f3a8-48ba-beca-156017c1f600 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1464 microversion: 2.1 time: 0.384413 Jul 26 15:09:20.979657 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 288/586] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:20 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:21.044758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:21.045275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:21.064195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.064195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.064845 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.065284 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.121162 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:09:21.231706 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:21.232221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:21.239446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.240012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.240921 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.241615 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.514315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-50763f48-267c-4afd-b4e8-b97eec65f51d tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "DELETE /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 204 len: 0 microversion: 2.1 time: 0.474526 Jul 26 15:09:21.516257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 299/587] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:09:21 2022] DELETE /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:09:21.522974 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:21.523706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:21.531156 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.532003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.533065 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.536256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.627247 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:21.627692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:21.627692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d3b0eae7-8da3-46dd-be34-79f111e683de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1277 microversion: 2.1 time: 0.106369 Jul 26 15:09:21.627692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 300/588] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:21 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:21.630883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:21.631809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:21.634713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-01f7599c-1264-4691-8510-bd365d74267a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.406916 Jul 26 15:09:21.635841 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 289/589] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:21 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:21.646162 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.646872 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.647994 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:21.648583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:21.842529 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:21.851755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2388f6ec-5ce7-4a38-bc85-39880e86f858 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1470 microversion: 2.1 time: 0.225790 Jul 26 15:09:21.852780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 301/590] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:21 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:22.381814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-0955d9e1-3fff-46f4-9fa6-96959c7d2c20 req-005e3fe3-24e8-4e45-a36a-e0cab5eae40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "name": "network-vif-plugged", "status": "completed", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:22.392339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0955d9e1-3fff-46f4-9fa6-96959c7d2c20 req-005e3fe3-24e8-4e45-a36a-e0cab5eae40f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.392785 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0955d9e1-3fff-46f4-9fa6-96959c7d2c20 req-005e3fe3-24e8-4e45-a36a-e0cab5eae40f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.405406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-0955d9e1-3fff-46f4-9fa6-96959c7d2c20 req-005e3fe3-24e8-4e45-a36a-e0cab5eae40f service nova] Creating event network-vif-plugged:79dc17dd-0f41-4a9f-9307-9de726b3d06e for instance 440d23f7-96c6-46ce-b2ff-147c4070509b on hv-cinder-85066 Jul 26 15:09:22.421134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-0955d9e1-3fff-46f4-9fa6-96959c7d2c20 req-005e3fe3-24e8-4e45-a36a-e0cab5eae40f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034454 Jul 26 15:09:22.421134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 290/591] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:22.650650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:22.651373 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:22.659550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.660369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.661244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.661758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.671137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:22.682159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:22.701327 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.704292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.704292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.704292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.865707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:22.875498 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9ee1dbf1-17d3-4d07-ad76-734ce5c1056e tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.231115 Jul 26 15:09:22.876355 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 302/592] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:22 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:22.887851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:22.887851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:22.900315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.900876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.902311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:22.902311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:22.980389 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:22.996523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ee2cf050-25e4-42ac-817e-2b23e858545c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.330732 Jul 26 15:09:22.997131 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 291/593] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:22 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:23.176971 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:23.186340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9b64fff2-b686-490a-a65f-316d116d5aa0 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1470 microversion: 2.1 time: 0.308594 Jul 26 15:09:23.187404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 303/594] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:22 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:23.900820 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:23.902077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:23.916128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:23.916908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:23.917901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:23.918343 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:24.019372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:24.020398 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:24.030831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:24.034852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:24.036418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:24.049166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:24.398273 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:24.410240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-87b2f3d6-b6f0-4118-ab48-e85642faf254 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.513232 Jul 26 15:09:24.512792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 292/595] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:23 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:24.512792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:24.512792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:24.512792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:24.513800 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:24.513800 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:24.513800 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:24.540972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:24.547601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:24.556956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b04bf3ff-e182-4775-8baa-bebd9fc74892 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.542659 Jul 26 15:09:24.560534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 304/596] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:24 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:24.566857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-bce39dc4-ecb7-4dab-815c-1b4e03b133c6 req-99298cb8-3048-4943-9cd8-f47bc3854ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac7a938-7f02-4e37-b392-bfd28ec5c72a", "name": "network-vif-deleted", "tag": "e638e0cf-c4c9-4836-b1a0-4cc190f7394c"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:24.579788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-bce39dc4-ecb7-4dab-815c-1b4e03b133c6 req-99298cb8-3048-4943-9cd8-f47bc3854ed0 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:24.581206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-bce39dc4-ecb7-4dab-815c-1b4e03b133c6 req-99298cb8-3048-4943-9cd8-f47bc3854ed0 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:24.585232 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:24.591029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:24.598127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-676cd562-9d8e-4040-9ffb-96fad88cd7ee tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1428 microversion: 2.1 time: 0.181705 Jul 26 15:09:24.599078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 293/597] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:24 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1428 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:24.605181 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-bce39dc4-ecb7-4dab-815c-1b4e03b133c6 req-99298cb8-3048-4943-9cd8-f47bc3854ed0 service nova] Creating event network-vif-deleted:e638e0cf-c4c9-4836-b1a0-4cc190f7394c for instance cac7a938-7f02-4e37-b392-bfd28ec5c72a on hv-cinder-85066 Jul 26 15:09:24.614831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-bce39dc4-ecb7-4dab-815c-1b4e03b133c6 req-99298cb8-3048-4943-9cd8-f47bc3854ed0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051743 Jul 26 15:09:24.615861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 305/598] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:25.509966 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:25.526841 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:25.528543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.529128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.530127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.531499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.589340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:25.592659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:25.600475 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.601310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.602202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.602632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.833323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:25.841804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8fdc7815-9d12-4529-9baf-45a86a6029f5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.340770 Jul 26 15:09:25.842598 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 294/599] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:25 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:25.852331 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:25.858129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:25.859047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:25.866691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-19f26911-a134-4ed5-971f-9ea5a2500bb6 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1259 microversion: 2.1 time: 0.288749 Jul 26 15:09:25.866998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 306/600] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:25 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:25.871826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-f3ed6595-75ae-46a2-83ba-5a84f7cf92dc req-8950e62c-87a7-410b-921c-61e77f0f334e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e619d0f5-b226-428e-8e2f-2f876d919fef", "tag": "795cd60f-efea-4474-938b-0fb035fd2965"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:25.878679 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.879392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.880378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.882024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.885637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-f3ed6595-75ae-46a2-83ba-5a84f7cf92dc req-8950e62c-87a7-410b-921c-61e77f0f334e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:25.886152 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-f3ed6595-75ae-46a2-83ba-5a84f7cf92dc req-8950e62c-87a7-410b-921c-61e77f0f334e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:25.903382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-f3ed6595-75ae-46a2-83ba-5a84f7cf92dc req-8950e62c-87a7-410b-921c-61e77f0f334e service nova] Creating event network-changed:795cd60f-efea-4474-938b-0fb035fd2965 for instance e619d0f5-b226-428e-8e2f-2f876d919fef on hv-cinder-85066 Jul 26 15:09:25.911154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-f3ed6595-75ae-46a2-83ba-5a84f7cf92dc req-8950e62c-87a7-410b-921c-61e77f0f334e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042175 Jul 26 15:09:25.912168 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 307/601] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:26.009823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:26.043050 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6ec4c94a-0582-401c-a7e4-512abbac5fef tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1299 microversion: 2.1 time: 0.168768 Jul 26 15:09:26.043941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 295/602] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:25 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:26.216523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:26.217397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:26.230253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.231127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.232603 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.233387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.280594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3f05fc96-ed9d-40df-9bbd-f47675a5942c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/ips" status: 200 len: 150 microversion: 2.1 time: 0.055464 Jul 26 15:09:26.280594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 308/603] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:09:26 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:26.302508 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b8b50b-143c-4553-922b-e5241cde486e"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:26.310399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:26.331281 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.332184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.341118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.342357 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.471358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Invalid volume: volume 57b8b50b-143c-4553-922b-e5241cde486e is already attached to instances: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: POST /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/os-volume_attachments HTTP/1.1 Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 74 Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:09:26.473234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {"volumeAttachment": {"volumeId": "57b8b50b-143c-4553-922b-e5241cde486e"}} Jul 26 15:09:26.474666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Invalid volume: volume 57b8b50b-143c-4553-922b-e5241cde486e is already attached to instances: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'server_id': '22db4394-5de8-471c-8738-b0484e5f7032', 'body': {'volumeAttachment': {'volumeId': '57b8b50b-143c-4553-922b-e5241cde486e'}}} Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 57b8b50b-143c-4553-922b-e5241cde486e is already attached to instances: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:09:26.475537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 57b8b50b-143c-4553-922b-e5241cde486e is already attached to instances: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:26.477109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 57b8b50b-143c-4553-922b-e5241cde486e is already attached to instances: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 400 to user: Invalid volume: volume 57b8b50b-143c-4553-922b-e5241cde486e is already attached to instances: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-967be017-ab50-48f4-aefc-23bc705e9e1c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.183173 Jul 26 15:09:26.478821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 296/604] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:09:26 2022] POST /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032/os-volume_attachments => generated 174 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:09:26.486337 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:26.487339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:26.503287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.506174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.507064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.507548 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.542501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:09:26.864066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:26.866963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:26.870184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:26.901272 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.903033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.905189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:26.905808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:26.955113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=8 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:27.065093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2e3b8455-dc89-4f3f-a496-400320621b95 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 204 len: 0 microversion: 2.1 time: 0.583713 Jul 26 15:09:27.066811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 309/605] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:09:26 2022] DELETE /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:09:27.074902 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:27.080132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:27.094728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.108666 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.111211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.112517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.167273 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:27.182730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cc9dcf25-d297-4045-bd44-c1792f7ca2e8 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.318994 Jul 26 15:09:27.189267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 297/606] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:26 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:27.202106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:27.205095 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:27.226611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.227309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.228303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.228927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.336955 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.340102 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.347501 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lazy-loading 'fault' on Instance uuid cac7a938-7f02-4e37-b392-bfd28ec5c72a {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:27.435678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:27.442482 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:27.460914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0310ff09-d4d2-47d1-b6bd-0b7f678e34e2 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1304 microversion: 2.1 time: 0.270249 Jul 26 15:09:27.467391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d6b98a30-1c4a-4b5a-8e6f-9c7f669e83ce tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1443 microversion: 2.1 time: 0.399091 Jul 26 15:09:27.470076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 298/608] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:27 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:27.470395 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 310/608] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:27 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1443 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:27.481521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:27.481521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:27.493202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.494492 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.507231 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:27.508181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:27.512748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.514204 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.528978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.529448 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.534061 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:27.535697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:27.723380 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:27.734222 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-95c5de18-b1f5-4677-84a2-3aceda233d3f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1683 microversion: 2.1 time: 0.261094 Jul 26 15:09:27.735244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 311/609] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:27 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1683 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:27.759054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:27.773491 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-347893b1-32f1-41a5-ab10-fa37bab6bf03 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1443 microversion: 2.1 time: 0.272451 Jul 26 15:09:27.778609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 299/610] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:27 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1443 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:28.218121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:28.221427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:28.224503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:28.237214 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.237999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.239497 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.242145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.506540 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:28.507793 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:28.523148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.523148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.531879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.533027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.621781 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.628377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.629117 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lazy-loading 'fault' on Instance uuid cac7a938-7f02-4e37-b392-bfd28ec5c72a {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:28.649071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:28.664772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ae56831d-112e-4127-9466-cfced45a188b tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.458962 Jul 26 15:09:28.681209 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 312/611] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:28 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:28.760039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:28.760039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:28.769959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aafb57f34153410783daed91152fa43b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484282e33cd64579b59888ba08ef08c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:28.776049 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.776774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.777898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:28.778535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:28.790703 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-12dbe5ee-6622-4e8d-85dd-8fa1f535fe22 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 200 len: 1304 microversion: 2.1 time: 0.291005 Jul 26 15:09:28.797105 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 300/612] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:28 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:28.958953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:28.968918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a4f1e2f1-cfc8-4c9a-9f6e-c72b18b9a867 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1683 microversion: 2.1 time: 0.214259 Jul 26 15:09:28.970418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 313/613] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:28 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:29.687256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:29.688593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:29.699212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:29.699779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:29.700714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:29.712255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:29.820411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:29.821293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] [instance: cac7a938-7f02-4e37-b392-bfd28ec5c72a] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:29.828342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:29.829747 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:29.831158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:29.831812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:29.849440 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] HTTP exception thrown: Instance cac7a938-7f02-4e37-b392-bfd28ec5c72a could not be found. Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Request method failure captured: Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a HTTP/1.1 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AN3v4edQ__WBo7eGElVyYiopHwu2K4URhQHIziU_8_zjtgCMDa9whbLEDOBlU-2GWDxg2lbnNrlTOStTrwYZCtkNAv8JpdLnmnebBRpNzTtQRH6NjA1DD9wpfaMjaALcOS4EMog05ZUq7_azdFTO0HD-KjUHsM5tnE420Bj7DLMSU8 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 484282e33cd64579b59888ba08ef08c5 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesNegativeTest-1107023949 Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:09:29.855751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_484282e33cd64579b59888ba08ef08c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/484282e33cd64579b59888ba08ef08c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/484282e33cd64579b59888ba08ef08c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/484282e33cd64579b59888ba08ef08c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesNegativeTest-1107023949 Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 484282e33cd64579b59888ba08ef08c5 Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesNegativeTest-1107023949 Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesNegativeTest-1107023949-project Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: aafb57f34153410783daed91152fa43b Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesNegativeTest-1107023949-project Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance cac7a938-7f02-4e37-b392-bfd28ec5c72a could not be found. Jul 26 15:09:29.860342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'cac7a938-7f02-4e37-b392-bfd28ec5c72a'} Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac7a938-7f02-4e37-b392-bfd28ec5c72a could not be found. Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:29.861246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac7a938-7f02-4e37-b392-bfd28ec5c72a could not be found. Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac7a938-7f02-4e37-b392-bfd28ec5c72a could not be found. Jul 26 15:09:29.862657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:29.863960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] Returning 404 to user: Instance cac7a938-7f02-4e37-b392-bfd28ec5c72a could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:29.863960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-daa12182-cc7f-4ca8-8ad7-205ca2651eb3 tempest-VolumesNegativeTest-1107023949 tempest-VolumesNegativeTest-1107023949-project] 10.222.0.94 "GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a" status: 404 len: 111 microversion: 2.1 time: 0.041201 Jul 26 15:09:29.863960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 314/614] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:29 2022] GET /compute/v2.1/servers/cac7a938-7f02-4e37-b392-bfd28ec5c72a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:09:29.994699 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:29.997756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:30.016885 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:30.021115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:30.021571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:30.025593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:30.026110 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:30.044348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ce9760ce-c72a-43e2-bb0d-718ff396ab0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.353384 Jul 26 15:09:30.045983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 301/615] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:29 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:30.337324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:30.356714 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ac2dcee7-efad-4d1e-967e-ac5acf1e22be tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1615 microversion: 2.1 time: 0.369483 Jul 26 15:09:30.358588 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 315/616] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:29 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1615 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:30.465808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-dad9e41e-61aa-49cc-a1bc-3e3c16ae81b2 req-ddc94f90-53ea-4605-932d-218b2a930ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22db4394-5de8-471c-8738-b0484e5f7032", "name": "network-vif-deleted", "tag": "58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:30.496377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-dad9e41e-61aa-49cc-a1bc-3e3c16ae81b2 req-ddc94f90-53ea-4605-932d-218b2a930ab3 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:30.505414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-dad9e41e-61aa-49cc-a1bc-3e3c16ae81b2 req-ddc94f90-53ea-4605-932d-218b2a930ab3 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:30.546561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-dad9e41e-61aa-49cc-a1bc-3e3c16ae81b2 req-ddc94f90-53ea-4605-932d-218b2a930ab3 service nova] Creating event network-vif-deleted:58fa1ec6-f94e-4a2a-8dc1-e9dd2b17d76a for instance 22db4394-5de8-471c-8738-b0484e5f7032 on hv-cinder-85066 Jul 26 15:09:30.557239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-dad9e41e-61aa-49cc-a1bc-3e3c16ae81b2 req-ddc94f90-53ea-4605-932d-218b2a930ab3 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095402 Jul 26 15:09:30.557835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 302/617] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:31.067176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:31.067961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:31.074693 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.075130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.075937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.076419 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.238078 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:31.249239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-79e0abbf-ed84-445f-a298-d53e4adfc1e5 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.186815 Jul 26 15:09:31.250642 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 316/618] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:31 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:31.385499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:31.385999 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:31.392830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:31.393539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:31.404235 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.410917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.411903 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.412522 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.412911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.413087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.414227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.414673 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.459635 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:31.461065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:31.461759 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'fault' on Instance uuid 22db4394-5de8-471c-8738-b0484e5f7032 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:31.536428 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:31.539619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lazy-loading 'services' on Instance uuid 6d42296f-f3c6-4b95-999e-7b15b6537bfd {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:31.555049 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-16e6cb0f-9469-435a-ae11-046932d56575 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1332 microversion: 2.1 time: 0.175449 Jul 26 15:09:31.571168 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 303/619] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:31 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:32.018651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-febe3b7a-ea61-496a-b189-63653414f6c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-volume_attachments/af8dace4-5e8b-4dfd-8300-e8bcc835fbc3" status: 202 len: 0 microversion: 2.1 time: 0.636974 Jul 26 15:09:32.023706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 317/620] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:09:31 2022] DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-volume_attachments/af8dace4-5e8b-4dfd-8300-e8bcc835fbc3 => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:09:32.273038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:32.273678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:32.298978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:32.300083 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:32.303708 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:32.304155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:32.525429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-35e3c4ef-c935-47b8-9dd0-eca6d82aaaff req-45b5f04a-32fc-4c57-823e-06a8762cb942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:32.547977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-35e3c4ef-c935-47b8-9dd0-eca6d82aaaff req-45b5f04a-32fc-4c57-823e-06a8762cb942 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:32.554556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-35e3c4ef-c935-47b8-9dd0-eca6d82aaaff req-45b5f04a-32fc-4c57-823e-06a8762cb942 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:32.579994 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-35e3c4ef-c935-47b8-9dd0-eca6d82aaaff req-45b5f04a-32fc-4c57-823e-06a8762cb942 service nova] Creating event network-changed:79dc17dd-0f41-4a9f-9307-9de726b3d06e for instance 440d23f7-96c6-46ce-b2ff-147c4070509b on hv-cinder-85066 Jul 26 15:09:32.596206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-35e3c4ef-c935-47b8-9dd0-eca6d82aaaff req-45b5f04a-32fc-4c57-823e-06a8762cb942 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077942 Jul 26 15:09:32.597498 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 318/621] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:32.603271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:32.604000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:32.626411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:32.628016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:32.630899 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:32.631561 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:32.701670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:32.706485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:32.712013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:32.712713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'fault' on Instance uuid 22db4394-5de8-471c-8738-b0484e5f7032 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:32.715501 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-dec71d4c-745c-4191-8484-85dfc859c1c0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.447906 Jul 26 15:09:32.722808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 304/622] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:32 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:32.804854 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:32.819381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d4f940c5-2cbc-4959-9639-71bc4c3468a4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 200 len: 1332 microversion: 2.1 time: 0.220464 Jul 26 15:09:32.821132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 319/623] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:32 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 1332 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:33.741679 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:33.743311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:33.760262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:33.760732 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:33.762441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:33.784922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:33.844514 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:33.846198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:33.854256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:33.855166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:33.856715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:33.857416 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:33.882438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 HTTP/1.1 Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:09:33.884585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:09:33.885952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '22db4394-5de8-471c-8738-b0484e5f7032'} Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:33.886774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:09:33.888550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:33.893580 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:33.899094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-76e2bd02-54c1-439d-ab82-7899d519dad0 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 404 len: 111 microversion: 2.1 time: 0.055152 Jul 26 15:09:33.900667 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 320/624] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:33 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:09:33.911850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-986031f8-4c79-417a-8632-bd381feaafda tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '.version_select at 0x7f4532b45820>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:34.037870 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:34.040186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-986031f8-4c79-417a-8632-bd381feaafda tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310210035" status: 202 len: 0 microversion: 2.1 time: 0.135361 Jul 26 15:09:34.041055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 321/625] 10.222.0.94 () {58 vars in 1221 bytes} [Tue Jul 26 15:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310210035 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:09:34.048350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-407beaa4-7cf8-4402-bec8-9e94da33644c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.309921 Jul 26 15:09:34.048350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 305/626] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:33 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:34.343612 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0617038f-7eaa-48e3-b03a-b0d4e5a45e88 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:34.357385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0617038f-7eaa-48e3-b03a-b0d4e5a45e88 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:34.365567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0617038f-7eaa-48e3-b03a-b0d4e5a45e88 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:34.404887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0617038f-7eaa-48e3-b03a-b0d4e5a45e88 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Going to try to stop instance {{(pid=130762) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 15:09:34.434312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:34.727755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-482b43a4-aca3-417e-97b8-90950a7f59e7 req-b45f6d83-1e7f-4932-8869-260d0c9c14e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e619d0f5-b226-428e-8e2f-2f876d919fef", "name": "network-vif-plugged", "status": "completed", "tag": "795cd60f-efea-4474-938b-0fb035fd2965"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:34.742724 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-482b43a4-aca3-417e-97b8-90950a7f59e7 req-b45f6d83-1e7f-4932-8869-260d0c9c14e8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:34.764079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-482b43a4-aca3-417e-97b8-90950a7f59e7 req-b45f6d83-1e7f-4932-8869-260d0c9c14e8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:34.773021 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-482b43a4-aca3-417e-97b8-90950a7f59e7 req-b45f6d83-1e7f-4932-8869-260d0c9c14e8 service nova] Creating event network-vif-plugged:795cd60f-efea-4474-938b-0fb035fd2965 for instance e619d0f5-b226-428e-8e2f-2f876d919fef on hv-cinder-85066 Jul 26 15:09:34.786361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-482b43a4-aca3-417e-97b8-90950a7f59e7 req-b45f6d83-1e7f-4932-8869-260d0c9c14e8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061800 Jul 26 15:09:34.788517 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 306/627] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:34.851103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0617038f-7eaa-48e3-b03a-b0d4e5a45e88 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.511366 Jul 26 15:09:34.854711 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 322/628] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:09:34 2022] POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:09:34.860712 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:34.867938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:34.873725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:34.874173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:34.875175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:34.875798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.055793 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:35.066336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a2d67dd6-73f9-4d64-9f17-467442875788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.209938 Jul 26 15:09:35.073903 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:35.074928 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:35.080091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 307/629] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:34 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:35.089577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb8ff007-87f0-42b8-b51b-7261d3347dc0"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:35.092249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:35.092657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:35.093233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.094915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:35.095223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.099055 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:35.099700 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.100869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:35.101498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.412538 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:35.420927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9108d823-5b44-451b-bfef-cb65069022fa tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.356185 Jul 26 15:09:35.424317 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 323/630] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:35 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:35.536550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:35.537150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:35.544024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:35.544850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.547541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:35.548360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:35.652944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'services' on Instance uuid 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:36.057808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-766941aa-a9f2-4a1b-9830-28c833f38bc9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments/57b8b50b-143c-4553-922b-e5241cde486e" status: 202 len: 0 microversion: 2.1 time: 0.525999 Jul 26 15:09:36.063637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 324/631] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:09:35 2022] DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments/57b8b50b-143c-4553-922b-e5241cde486e => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:09:36.073457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:36.076772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:36.086672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:36.087193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:36.088163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:36.088596 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:36.135549 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f04cf457-e840-4de1-922e-fef92cd26faa tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067061 Jul 26 15:09:36.136697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 325/632] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:09:36 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:36.152844 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:36.154384 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:36.165947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:36.166711 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:36.168451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:36.168956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:36.395171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:36.407339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0c95cd90-7819-4f95-98fd-7797c93d37dc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.258742 Jul 26 15:09:36.407339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 326/633] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:36 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:36.452567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:36.453786 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:36.462485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:36.462988 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:36.463859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:36.464388 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:36.474090 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-85de6e3a-7ad9-4416-90dc-ba3c2469a979 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.392561 Jul 26 15:09:36.477116 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 308/634] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:09:35 2022] POST /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments => generated 194 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:36.631816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:36.642659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-af50ea11-3c67-4214-8f7f-c76f230e4c0c tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.194322 Jul 26 15:09:36.644580 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 327/635] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:36 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:37.151834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:37.154096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:37.160969 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:37.161448 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:37.162244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:37.162691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:37.182091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:37.196959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2773849b-7278-4b1d-8715-421dc0037aa2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050116 Jul 26 15:09:37.203568 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 309/636] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:09:37 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:37.428065 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:37.428687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:37.435409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:37.435907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:37.436829 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:37.437439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:37.609085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:37.643741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-534a6cba-10dc-4f6c-aab3-7707102df7d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.219539 Jul 26 15:09:37.663261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 328/637] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:37 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:37.700016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:37.700681 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:37.710047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:37.712280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:37.712280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:37.712280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:37.939842 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:37.949511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4a9613ea-768f-4af7-8d81-7b637fc279de tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1319 microversion: 2.1 time: 0.254705 Jul 26 15:09:37.950326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 310/638] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:37 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:38.211423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:38.214064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:38.221713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:38.222395 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:38.223390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:38.224039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:38.258317 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8cce53cd-8b07-4791-b72e-a3c2686635fb tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051678 Jul 26 15:09:38.259303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 329/639] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:09:38 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:38.669638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:38.670294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:38.678716 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:38.679315 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:38.680226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:38.680861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:38.790651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e4812109-d682-44ba-9594-b93d45d65126 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Action: 'create', calling method: .version_select at 0x7f4532b32c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-817176606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSmB59cNmVfhhC855JbebifmWte7OjGUtZbL0wkkd4o23Ml4PfdpHxgGl6aNgqfug7O6Z7F2cCnHX95uWM9aJfe3oY19KvQ/Kp7dzAiChtTrqdOp3xJCvmF74reLM2/ow=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:38.808312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-e4812109-d682-44ba-9594-b93d45d65126 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Getting quotas for project ee9262c91631413b991af2efeb169cd0. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:09:38.813803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-e4812109-d682-44ba-9594-b93d45d65126 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Getting quotas for user 9ab7f2a0dcf64aa2ba8c891fc59bc8d2 and project ee9262c91631413b991af2efeb169cd0. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:09:38.834065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:38.841608 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-20974395-dd2c-4488-8218-b5a32ac54fc4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.175911 Jul 26 15:09:38.842181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 311/640] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:38 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:38.974442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:38.975183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:38.982983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:38.982983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:38.983230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:38.983606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.004344 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e4812109-d682-44ba-9594-b93d45d65126 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.216784 Jul 26 15:09:39.005563 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 330/641] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:09:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:39.087258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1957728322", "imageRef": "59431852-fead-468c-919c-060011c3b72f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-817176606", "networks": [{"uuid": "f00b30d1-b798-458a-a4ac-371e3eae95f6"}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:39.142829 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:39.147248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] validate_networks() for [('f00b30d1-b798-458a-a4ac-371e3eae95f6', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:09:39.159778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-04f6b977-d4e1-4100-a47b-bde3087ede7f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1508 microversion: 2.1 time: 0.186150 Jul 26 15:09:39.160803 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 312/642] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:38 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:39.185461 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5ba12b8-6c7a-4261-b897-111b29807d90", "device": "/dev/sdb"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:39.191421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:39.198624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:39.199107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.206641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:39.207109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.583872 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:09:39.584471 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:09:39.585127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:09:39.585738 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:09:39.586355 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:09:39.598826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:39.599267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.600136 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:39.600572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.625910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Getting quotas for project ee9262c91631413b991af2efeb169cd0. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:09:39.628050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:39.631722 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Getting quotas for user 9ab7f2a0dcf64aa2ba8c891fc59bc8d2 and project ee9262c91631413b991af2efeb169cd0. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:09:39.656076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:09:39.660211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59431852-fead-468c-919c-060011c3b72f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:09:39.832005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-449ce4f7-ce85-43e4-ad7f-4943a067e57e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748389 Jul 26 15:09:39.832679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 331/643] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:09:39.837933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:39.840562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:39.848872 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:39.849466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.850125 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:39.850562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:39.885154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2be8be8b-5e48-47be-98ef-04633805f42e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051293 Jul 26 15:09:39.885746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 332/644] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:09:39 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:09:39.898779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5cc15a5c-f962-40a7-8b28-c71ded22b2cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:39.899298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5cc15a5c-f962-40a7-8b28-c71ded22b2cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:39.977846 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5cc15a5c-f962-40a7-8b28-c71ded22b2cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:39.993145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5cc15a5c-f962-40a7-8b28-c71ded22b2cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1258 microversion: 2.1 time: 0.101621 Jul 26 15:09:39.993145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 333/645] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:39 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:39.994827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:39.996192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:40.003977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:40.005117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:40.005898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:40.006336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:40.141647 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:40.150231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-21eac563-fe34-4c88-8d9b-338955d45517 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.159968 Jul 26 15:09:40.150832 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 334/646] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:39 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:40.155759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:40.156741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:40.163507 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:40.163942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:40.164734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:40.165145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:40.193072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:09:40.691860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-337af832-642c-46e5-a542-162791f33ff7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 204 len: 0 microversion: 2.1 time: 0.539654 Jul 26 15:09:40.692455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 335/647] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:09:40 2022] DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:09:40.701794 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:40.702543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:40.709746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:40.710207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:40.711032 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:40.711477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:40.770457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e86fd058-93e8-4774-96f7-9ddc1fa3d40a tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "POST /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.589058 Jul 26 15:09:40.771790 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 313/648] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:09:39 2022] POST /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef/os-volume_attachments => generated 194 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:40.872446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:40.881318 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b79d2164-c917-4c8d-8546-ca5b0d3e4d92 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1681 microversion: 2.1 time: 0.183956 Jul 26 15:09:40.881991 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 336/649] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:40 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:41.011341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3148846c-7b83-46ea-a2cc-86214bb59e9e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:41.012051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3148846c-7b83-46ea-a2cc-86214bb59e9e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:41.069168 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3148846c-7b83-46ea-a2cc-86214bb59e9e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:41.076084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3148846c-7b83-46ea-a2cc-86214bb59e9e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1258 microversion: 2.1 time: 0.069431 Jul 26 15:09:41.076691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 314/650] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:41 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:41.171772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:41.173232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:41.180081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:41.180528 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:41.182908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:41.182908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:41.338805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:41.346673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d6f761e6-9db6-4381-9e19-2e07135a0bfb tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.178993 Jul 26 15:09:41.347250 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 337/651] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:41 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:41.914901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:41.916194 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:41.924595 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:41.925059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:41.925829 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:41.926276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:42.088486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:42.098694 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:42.099517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:42.099737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1f25fd1b-faa1-4310-9965-58d10fb54592 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1681 microversion: 2.1 time: 0.199076 Jul 26 15:09:42.100332 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 315/652] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:41 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:42.106890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:42.107522 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:42.108420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:42.108966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:42.182782 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:42.191021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2e000850-f16f-4c8e-ba54-e19f32d18786 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1262 microversion: 2.1 time: 0.097131 Jul 26 15:09:42.191622 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 338/653] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:42 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:42.368195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:42.368806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:42.375245 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:42.375730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:42.376691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:42.377125 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:42.513415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:42.521851 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6c2017b2-3d55-4adc-9ef1-eb8c88295587 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.157876 Jul 26 15:09:42.522435 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 316/654] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:42 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:43.124229 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:43.125043 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:43.135589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:43.136128 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:43.137060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:43.137520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:43.159224 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:43.216077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:43.216687 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:43.224760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:43.225214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:43.226098 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:43.226469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:43.298066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:43.311870 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1edd8a60-9ed3-450b-a7cf-649a90ecaba0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1310 microversion: 2.1 time: 0.094307 Jul 26 15:09:43.317858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 317/655] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:43 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:43.423520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:43.432169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9b136c38-cbaf-4301-83c0-7b755f693455 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1681 microversion: 2.1 time: 0.312231 Jul 26 15:09:43.432772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 339/656] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:43 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:43.544911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:43.545533 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:43.553236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:43.553744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:43.554564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:43.555012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:43.741388 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:43.751929 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-01130793-db8f-4bc9-a5ba-242de7a285c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.211128 Jul 26 15:09:43.752499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 318/657] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:43 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:43.987652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-011b5a60-9619-4644-bd38-d65c40eef3cf req-b8fa544b-5cfa-4f25-a201-e34632d74196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e94e2c3-8b57-4a91-831d-7afb4e64dcaf", "name": "network-vif-deleted", "tag": "957f7279-c7e0-4980-871c-ba5e2033c52a"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:44.010966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-011b5a60-9619-4644-bd38-d65c40eef3cf req-b8fa544b-5cfa-4f25-a201-e34632d74196 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.014637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-011b5a60-9619-4644-bd38-d65c40eef3cf req-b8fa544b-5cfa-4f25-a201-e34632d74196 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.031881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-011b5a60-9619-4644-bd38-d65c40eef3cf req-b8fa544b-5cfa-4f25-a201-e34632d74196 service nova] Creating event network-vif-deleted:957f7279-c7e0-4980-871c-ba5e2033c52a for instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf on hv-cinder-85066 Jul 26 15:09:44.038991 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-011b5a60-9619-4644-bd38-d65c40eef3cf req-b8fa544b-5cfa-4f25-a201-e34632d74196 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056515 Jul 26 15:09:44.040171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 340/658] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:44.331406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:44.332714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:44.342275 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.342826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.343934 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.344732 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.446815 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:44.461199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:44.466665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:44.472484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-75d8100d-baf3-4221-a63a-e44c3c230492 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1318 microversion: 2.1 time: 0.147875 Jul 26 15:09:44.490189 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.493001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.493374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 319/659] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:44 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:44.496924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.498768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.551785 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.552587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.553223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'fault' on Instance uuid 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:44.776920 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:44.777806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:44.785187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.785857 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.786923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:44.787569 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:44.914670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:44.932982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-384b4127-79f4-4b8d-9948-0d9b61d04df8 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1329 microversion: 2.1 time: 0.480716 Jul 26 15:09:44.935068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 341/660] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:44 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1329 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:45.005609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:45.014439 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-68892745-2863-4bfe-99bb-bd8bfa69a2ea tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1678 microversion: 2.1 time: 0.243506 Jul 26 15:09:45.017809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 320/661] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:44 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:45.501977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:45.503239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:45.509754 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:45.510466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:45.511388 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:45.511715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:45.754816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:45.764667 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3c50395f-449d-4d57-b894-1d6aeaec867c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.268345 Jul 26 15:09:45.766680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 342/662] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:45 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:45.970813 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:45.972121 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:45.975065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:45.984460 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:45.984460 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:45.984460 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:45.984460 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.036566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:46.037020 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.037490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'fault' on Instance uuid 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:46.046122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:46.063426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:46.091822 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:46.094133 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.098027 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:46.099526 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.112185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:46.138173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-abac1bfe-c684-4e3e-8527-c574803a4313 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 200 len: 1329 microversion: 2.1 time: 0.172793 Jul 26 15:09:46.147299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 321/663] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:45 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 1329 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:46.713465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:46.722852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e1b7649e-32b0-49be-af83-31af941eb460 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1655 microversion: 2.1 time: 0.685567 Jul 26 15:09:46.739961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 343/664] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:46 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1655 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:46.746404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ea378bfc-7fbb-42a3-85a6-72d634ccfa1c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:46.754320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ea378bfc-7fbb-42a3-85a6-72d634ccfa1c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:46.754761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ea378bfc-7fbb-42a3-85a6-72d634ccfa1c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.802196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:46.803219 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:46.815909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:46.816637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.817726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:46.818358 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:46.842268 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ea378bfc-7fbb-42a3-85a6-72d634ccfa1c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Going to try to start instance {{(pid=130764) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 15:09:47.142354 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:47.159323 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-26dcf780-5dfd-4c1b-bb82-29c047644c22 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.360468 Jul 26 15:09:47.161621 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 344/665] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:46 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:47.186506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:47.188351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:47.200663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:47.201803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:47.205591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:47.207286 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:47.217092 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ea378bfc-7fbb-42a3-85a6-72d634ccfa1c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.474535 Jul 26 15:09:47.218792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 322/666] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:09:46 2022] POST /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:09:47.238939 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:47.240971 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:47.271633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:09:47.271926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:47.271926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:47.271926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:47.271926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf HTTP/1.1 Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:09:47.273199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:09:47.281434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '2e94e2c3-8b57-4a91-831d-7afb4e64dcaf'} Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:47.283300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:09:47.288985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:09:47.290519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:47.290519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2c0a889a-492f-4642-bc0f-0a150a54f8db tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 404 len: 111 microversion: 2.1 time: 0.099746 Jul 26 15:09:47.290519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 345/667] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:47 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:09:47.309588 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f6b4a2b5-2e34-4aa2-b168-fbb015cacde4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '.version_select at 0x7f4532a743a0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:47.435383 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f6b4a2b5-2e34-4aa2-b168-fbb015cacde4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54661891" status: 202 len: 0 microversion: 2.1 time: 0.146641 Jul 26 15:09:47.440166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 346/668] 10.222.0.94 () {58 vars in 1215 bytes} [Tue Jul 26 15:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54661891 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:09:47.698452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:47.706946 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:47.731196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:47.732231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:47.738944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:47.740517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:47.816904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'flavor' on Instance uuid 530f5891-c2f5-4273-8ef0-c733ef667dc3 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:09:47.960088 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:47.977399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-419d2a4d-00c1-4a0a-adf3-37a2b292fddc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.746180 Jul 26 15:09:47.990858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 323/669] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:47 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:48.088410 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-5a969a54-183f-47fe-9c4b-6f0c5ea8d466 req-be30806f-4ed2-4a47-8d12-7a5683bc29fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:48.108616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5a969a54-183f-47fe-9c4b-6f0c5ea8d466 req-be30806f-4ed2-4a47-8d12-7a5683bc29fa service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:48.110591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5a969a54-183f-47fe-9c4b-6f0c5ea8d466 req-be30806f-4ed2-4a47-8d12-7a5683bc29fa service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:48.145649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-5a969a54-183f-47fe-9c4b-6f0c5ea8d466 req-be30806f-4ed2-4a47-8d12-7a5683bc29fa service nova] Creating event network-changed:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:09:48.152435 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-5a969a54-183f-47fe-9c4b-6f0c5ea8d466 req-be30806f-4ed2-4a47-8d12-7a5683bc29fa service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068456 Jul 26 15:09:48.164494 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 324/670] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:48.199207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:48.203978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:48.224922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:48.227934 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:48.229456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:48.230340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:48.244369 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:48.557777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b7c303fa-f08d-4137-a372-2c26740fa147 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/action" status: 200 len: 32 microversion: 2.1 time: 0.875216 Jul 26 15:09:48.563977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 347/671] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:09:47 2022] POST /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/action => generated 32 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:09:48.580248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:48.583929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:48.598559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:48.601394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:48.601394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:48.601394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:48.673400 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:48.683968 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-243ea3c9-21c4-4764-9d00-52c5d9c0619f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.504372 Jul 26 15:09:48.701587 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 325/672] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:48 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:48.946689 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:48.957349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0adc11ed-4215-4619-8320-f80a3d991cee tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.391775 Jul 26 15:09:48.958417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 348/673] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:48 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:48.997570 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:48.998558 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:49.011225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:49.011707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:49.012512 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:49.018486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:49.264268 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:49.284888 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7f5cd1ea-d308-459a-a05d-53002bc282d1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.291116 Jul 26 15:09:49.285463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 326/674] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:48 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:49.356310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6169117a-7e93-4004-9a2a-e6c8fac01857 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: .version_select at 0x7f45329a04c0>, body: {"keypair": {"name": "tempest-keypair-254421233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJOW6kPs3AYMKAdrFemEGHF+Hm9Q+iTkBrPxQRL0ytT5wSEhJ2eROC715aD1KvklKySu/OImwq8SXXg8yUFUcUqVGkJqgvHYDWt8kZONUlUHsRmUp2ytqE/7RLaqzMNxA=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:49.376054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-6169117a-7e93-4004-9a2a-e6c8fac01857 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:09:49.381576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-6169117a-7e93-4004-9a2a-e6c8fac01857 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:09:49.480780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6169117a-7e93-4004-9a2a-e6c8fac01857 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129092 Jul 26 15:09:49.486768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 349/675] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:09:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:49.709155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:49.709838 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:49.720355 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:49.725725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:49.725725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:49.725725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:49.902557 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:49.912890 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-55598e96-5cc5-4c39-b274-a91f3ea68c90 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.209975 Jul 26 15:09:49.916026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 327/676] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:49 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:49.977639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:49.982283 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:49.982909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:49.997346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:49.997857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:49.998571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:49.999006 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:50.161511 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:50.170149 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1cf05a3b-bdfa-40d4-a6ec-f8fb9d0dc8da tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.193256 Jul 26 15:09:50.170818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 350/677] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:49 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:50.306963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:50.307761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:50.314935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:50.315388 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:50.321868 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:50.321868 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:50.494170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:50.502625 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4a8e0b95-2dcf-46e6-bc46-d16f7d8b6f03 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.199588 Jul 26 15:09:50.503312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 328/678] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:50 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:50.945231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:50.949611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:50.960669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:50.961106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:50.962239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:50.963916 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:51.135495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:51.136727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-29359d8f-ddec-4f66-89be-b1d59622ee51 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.203310 Jul 26 15:09:51.137308 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 351/679] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:50 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:51.193067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:51.199516 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:51.200245 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:51.207872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:51.208402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:51.209367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:51.209805 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:51.357131 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:51.368274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-08b25105-8efa-4cc4-bbdc-ae90746d581b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.176277 Jul 26 15:09:51.377798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 329/680] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:51 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:51.530868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:51.531904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:51.538521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:51.538977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:51.539788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:51.540224 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:51.706624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:51.714984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-97e4f545-1f8e-47bf-a1e5-a79fa8359690 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.193702 Jul 26 15:09:51.729007 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 352/681] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:51 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:52.157664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:52.158683 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:52.174798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:52.175744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:52.177288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:52.178403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:52.397443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:52.398514 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:52.399150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:52.407534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:52.408290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:52.409267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:52.409860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:52.410013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-92682b9a-7167-438e-806d-01865febf8d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.256346 Jul 26 15:09:52.413532 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 330/682] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:52 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:52.569416 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:52.577353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-926e71c7-3a85-4da9-a905-b772291e31f0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.183538 Jul 26 15:09:52.579539 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 353/683] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:52 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:52.737690 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:52.738309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:52.745254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:52.745720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:52.746508 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:52.746944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:52.988378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:53.000325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-69069edf-1acf-47f9-a316-f2766ee176ee tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.266423 Jul 26 15:09:53.001346 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 331/684] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:52 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:53.434147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:53.434824 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:53.443055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.443580 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.444370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.444842 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.604735 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:53.605347 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:53.619723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.620114 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.620897 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.621340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.622625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:53.632034 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-18715440-c81f-49ca-9f95-04f6a9dfb08b tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.201615 Jul 26 15:09:53.649769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 354/685] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:53 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:53.656075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-712289381", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd3e2f67-4b42-4920-a974-5409190c3fa7"}], "security_groups": [{"name": "tempest-securitygroup--1627279052"}], "key_name": "tempest-keypair-254421233", "user_data": "}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:53.774421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:53.777679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] validate_networks() for [('bd3e2f67-4b42-4920-a974-5409190c3fa7', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:09:53.784183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-89ca2850-3eff-4a14-b7d6-c1cd550cf91a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.183149 Jul 26 15:09:53.784783 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 332/686] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:53 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:54.022638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:54.023350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:54.032589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.033157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.034060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.034831 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.198459 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:54.201784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:09:54.202809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:09:54.203379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:09:54.203892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:09:54.204382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:09:54.214134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.214381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-307580d2-e6c5-4c17-8671-662954bb99c1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.195587 Jul 26 15:09:54.215071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.231742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 333/687] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:54 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:54.231909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.231909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.241109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:09:54.246484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:09:54.259029 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:09:54.261403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:09:54.510733 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2445af4a-297d-4f79-ac0d-96043da5178a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.859262 Jul 26 15:09:54.511655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 355/688] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:09:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:09:54.523379 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-415fa6bb-3d78-4c2d-9cd3-cc23ab0bfd5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:54.524017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-415fa6bb-3d78-4c2d-9cd3-cc23ab0bfd5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:54.595263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-415fa6bb-3d78-4c2d-9cd3-cc23ab0bfd5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:54.602287 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-415fa6bb-3d78-4c2d-9cd3-cc23ab0bfd5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1240 microversion: 2.1 time: 0.082914 Jul 26 15:09:54.602862 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 334/689] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:54 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:54.657867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:54.658560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:54.665866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.666301 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.667070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.667710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.808111 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:54.809057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:54.866349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.866349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.866349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:54.866349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.867008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:54.867008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3015de5f-ac1a-4c2f-a8f3-530aca3f7325 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.186133 Jul 26 15:09:54.867008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 356/690] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:54 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:54.981197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:54.990780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5ccf7ff6-d608-4866-b1b6-932cb04b9c33 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.187749 Jul 26 15:09:54.993190 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 335/691] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:54 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:55.247229 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:55.248443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:55.257450 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:55.258246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:55.259921 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:55.260586 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:55.420839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:55.430134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:55.430134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bec7603e-7d5d-45eb-9b34-a4a38cbb5822 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.188116 Jul 26 15:09:55.430504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 357/692] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:55 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:55.623866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9b2fdd1d-95fd-44e5-a1f6-c4a1ccb7d74a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:55.625336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9b2fdd1d-95fd-44e5-a1f6-c4a1ccb7d74a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:55.683760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9b2fdd1d-95fd-44e5-a1f6-c4a1ccb7d74a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:55.691082 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9b2fdd1d-95fd-44e5-a1f6-c4a1ccb7d74a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1240 microversion: 2.1 time: 0.071217 Jul 26 15:09:55.691684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 336/693] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:55 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:55.889145 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:55.889774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:55.892443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:55.897483 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:55.897925 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:55.898685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:55.899112 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.017375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:56.018171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:56.025259 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:56.025735 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.026447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:56.026880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.034751 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:56.042788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ca7baa05-7ba7-4f12-bc27-85e3e03baba6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.157893 Jul 26 15:09:56.043489 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 358/694] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:55 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:56.163223 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:56.171949 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2df1713d-7c47-4820-8d87-4127406fedfb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.159174 Jul 26 15:09:56.172538 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 337/695] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:56 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:56.450656 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:56.451287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:56.459598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:56.460062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.460833 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:56.461259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.681630 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:56.689605 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d51ad280-ab1a-4a80-adfc-3d407841d516 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.242783 Jul 26 15:09:56.690481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 359/696] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:56 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:56.715137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:56.715137 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:56.720681 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:56.721279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.722163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:56.722593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:56.830060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:56.839147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-19b73d1c-f31c-4f05-a6f5-62061437b16e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1244 microversion: 2.1 time: 0.130075 Jul 26 15:09:56.839973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 338/697] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:56 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1244 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:57.067103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:57.067838 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:57.076062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.076702 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.078458 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.079085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.194260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:57.194845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:57.204024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.204573 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.205609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.206258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.228629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:57.248405 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cc7a6399-db9f-4152-9a7c-5aac8949c35f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.187126 Jul 26 15:09:57.248766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 360/698] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:57 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:57.493723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:57.502525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-400ca336-f9c1-45bf-8bd5-6e447691c5fb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.312372 Jul 26 15:09:57.503106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 339/699] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:57 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:57.712257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:57.712779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:57.719861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.720324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.721087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.721516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.854561 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:57.863233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0f5f1c5d-9da7-41d9-a6a0-f4a013572593 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1664 microversion: 2.1 time: 0.155382 Jul 26 15:09:57.863836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 361/700] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:57 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:57.920922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:57.922344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:57.928452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.928891 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.929649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:57.930078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:57.992096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:57.999766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0e145239-320c-49d0-8128-749437c94a4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1292 microversion: 2.1 time: 0.142121 Jul 26 15:09:58.000302 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 340/701] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:57 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:58.270517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:58.271122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:58.277908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:58.278354 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:58.279126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:58.279600 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:58.419846 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:58.427911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d5baf47b-ba00-4cb7-a493-ad6c7f60cc0c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.161051 Jul 26 15:09:58.428286 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 362/702] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:58 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:58.524317 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:58.524928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:58.531718 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:58.532170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:58.532943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:58.533503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:58.724636 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:58.734354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-21c3ef68-2d31-4b36-abfb-16a3a67879ae tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.213297 Jul 26 15:09:58.735002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 341/703] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:58 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:58.885620 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:58.886152 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:58.892653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:58.893101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:58.893864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:58.894298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.021178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:59.021789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:59.024817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:59.028100 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:59.028555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.029357 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:59.029821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.032514 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-26f8733d-c10a-4fa5-8d5f-9be529b9b0f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1668 microversion: 2.1 time: 0.151081 Jul 26 15:09:59.033077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 363/704] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:58 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:59.096497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:59.103980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5d20c343-b26d-400f-b6ce-596fc2082a57 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1292 microversion: 2.1 time: 0.086689 Jul 26 15:09:59.104544 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 342/705] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:59 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:59.449335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:59.449938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:59.457590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:59.458027 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.458847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:59.459274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.606767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:59.619569 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cd66c1fa-fecf-484e-a157-4025403b7434 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.173539 Jul 26 15:09:59.631687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 364/706] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:59 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:59.756430 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:59.757071 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:59.764355 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:59.764810 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.765619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:59.766057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:59.929560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:59.938064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:59.944063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-77dad2a8-e830-424d-a816-cd5664e309c2 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.191097 Jul 26 15:09:59.944771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 343/707] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:59 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:00.125210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:00.125711 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:00.132450 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:00.132892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:00.133643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:00.134073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:00.199806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:00.207802 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a3362be3-4bf3-456a-bc97-abeb98be1f06 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1310 microversion: 2.1 time: 0.086435 Jul 26 15:10:00.208419 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 365/708] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:00 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:00.641515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:00.642409 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:00.649525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:00.650168 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:00.650952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:00.651392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:00.793872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:00.802037 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a6e87161-a051-4e7a-a3c9-93a50274f3ab tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.164499 Jul 26 15:10:00.802624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 344/709] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:00 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:00.966272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:00.967093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:00.974687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:00.975142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:00.976106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:00.976755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:01.174305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:01.185137 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b62ef23b-869d-4ef1-a756-de4c5c229988 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.223087 Jul 26 15:10:01.191623 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 366/710] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:00 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:01.236261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:01.236261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:01.239925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:01.240553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:01.241830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:01.242377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:01.425928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:01.442038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b06d74fb-1e63-4e49-be89-c5c69019c9e6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.216597 Jul 26 15:10:01.447796 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 345/711] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:01 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:01.829806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:01.831160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:01.841484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:01.841929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:01.842711 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:01.843139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.065651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:02.074626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3c1c6938-9145-4803-ac0b-42dd19d11cd5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.253184 Jul 26 15:10:02.075232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 367/712] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:01 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:02.204743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-8d3f07b2-b60d-4363-9f1e-5e20633768a0 req-3ba589c3-2afe-4ba1-8447-58507919eb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02cbd58-fa78-47f5-ac51-4e1aa930e4f7", "tag": "719e7995-4710-47be-a9ec-6331681e1c1f"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:02.210194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:02.210901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:02.218256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-8d3f07b2-b60d-4363-9f1e-5e20633768a0 req-3ba589c3-2afe-4ba1-8447-58507919eb7b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:02.218455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:02.218576 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-8d3f07b2-b60d-4363-9f1e-5e20633768a0 req-3ba589c3-2afe-4ba1-8447-58507919eb7b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.218674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.219090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:02.219633 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.241904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-8d3f07b2-b60d-4363-9f1e-5e20633768a0 req-3ba589c3-2afe-4ba1-8447-58507919eb7b service nova] Creating event network-changed:719e7995-4710-47be-a9ec-6331681e1c1f for instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 on hv-cinder-85066 Jul 26 15:10:02.247340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-8d3f07b2-b60d-4363-9f1e-5e20633768a0 req-3ba589c3-2afe-4ba1-8447-58507919eb7b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042306 Jul 26 15:10:02.247340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 346/713] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:02.380575 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:02.395411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-466ce63c-95b0-4131-8ece-f4077e41f9bf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.190226 Jul 26 15:10:02.396150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 368/714] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:02 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:02.481599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:02.482737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:02.491337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:02.492175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.493147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:02.493797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.670223 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:02.678614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-35c63fc3-c385-4812-89f9-4bfb444f755c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.201209 Jul 26 15:10:02.693442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 347/715] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:02 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:02.696958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-c869d307-d7d3-4aad-b3b5-bb40cd22b55b req-c16b6c5d-9087-494f-9dd3-773b1b097ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "name": "network-vif-plugged", "status": "completed", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:02.709904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-c869d307-d7d3-4aad-b3b5-bb40cd22b55b req-c16b6c5d-9087-494f-9dd3-773b1b097ce0 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:02.710645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-c869d307-d7d3-4aad-b3b5-bb40cd22b55b req-c16b6c5d-9087-494f-9dd3-773b1b097ce0 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:02.725040 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-c869d307-d7d3-4aad-b3b5-bb40cd22b55b req-c16b6c5d-9087-494f-9dd3-773b1b097ce0 service nova] Creating event network-vif-plugged:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:10:02.740523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-c869d307-d7d3-4aad-b3b5-bb40cd22b55b req-c16b6c5d-9087-494f-9dd3-773b1b097ce0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041245 Jul 26 15:10:02.740523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 369/716] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:03.096541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:03.097186 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:03.103758 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:03.104347 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:03.105080 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:03.105511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:03.299996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:03.307828 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-942a7f09-cffc-4dbb-b81a-fd533fd0cbb5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.215472 Jul 26 15:10:03.312010 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 348/717] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:03 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:03.420179 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:03.420868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:03.427798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:03.428246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:03.429001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:03.429432 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:03.619632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:03.622606 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ead0b90b-6369-4f65-8142-9eacfdb88ba3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.206821 Jul 26 15:10:03.623186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 370/718] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:03 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:03.701242 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:03.701923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:03.709514 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:03.710266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:03.711940 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:03.712421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:03.861561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:03.869506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0e075243-443c-45aa-a0b1-fa4a0f2e4ddf tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.172334 Jul 26 15:10:03.870077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 349/719] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:03 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:04.330147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:04.330799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:04.333455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:04.334095 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=22 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:04.339207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:04.347884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:04.347884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:04.347884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:04.480318 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:04.488082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-763c9b19-0df9-4cb9-96ba-d12fc4e8355f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.162498 Jul 26 15:10:04.488656 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 371/720] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:04 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:04.645375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:04.646004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:04.652684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:04.653135 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:04.653906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:04.654342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:04.787292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:04.795298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-60bfed6b-bbf2-48e8-893c-9a1c38ba05dc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.154784 Jul 26 15:10:04.795924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 350/721] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:04 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:04.890839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:04.891494 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:04.898840 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:04.899294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:04.900133 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:04.900576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:05.034052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:05.041500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-08984a20-438c-4fce-964e-d7343fb176b9 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.155056 Jul 26 15:10:05.042070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 372/722] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:04 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:05.509247 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:05.509777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:05.515918 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:05.516373 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:05.517734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:05.518201 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:05.659421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:05.667500 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-37481bfb-e4a3-417d-b7d6-e463f7e9e9cc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.162105 Jul 26 15:10:05.668087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 351/723] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:05 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:05.819421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:05.820068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:05.829033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:05.830052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:05.830890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:05.831331 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:05.972264 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:05.980584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e3d8ba97-596f-4d1b-9c78-350e44c72d1c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.167016 Jul 26 15:10:05.981173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 373/724] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:05 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:06.064360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:06.064983 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:06.067187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=4 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:06.072328 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.072833 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.073688 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.074126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.212505 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:06.220369 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b5f2cc0f-a019-414f-a677-d220be5b551b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.160440 Jul 26 15:10:06.220904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 352/725] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:06 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:06.690035 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:06.691129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:06.701847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.702652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.704135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.704585 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.834612 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:06.842595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6fe6b2c8-0e9f-4222-8e28-4d80f4b19ce5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.157631 Jul 26 15:10:06.843186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 374/726] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:06 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:07.004646 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:07.005471 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:07.011832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.012278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.013054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.014639 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.147872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:07.156344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-df94888d-a426-4403-832d-cbf9eb759e17 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.156494 Jul 26 15:10:07.156933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 353/727] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:06 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:07.242554 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:07.243595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:07.249629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.250086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.251012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.252021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.257074 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=100 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:07.396912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:07.404837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e7485f11-afe6-45a7-af6b-c4b4bd93c10a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.166373 Jul 26 15:10:07.405586 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 375/728] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:07 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:07.865501 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:07.866219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:07.873034 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.873529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.874312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.874779 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:08.020226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:08.028188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-14e08543-d5c7-44b8-80e5-a42d7503c3ce tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1358 microversion: 2.1 time: 0.167839 Jul 26 15:10:08.028767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 354/729] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:07 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:08.314358 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:08.321066 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:08.321695 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:08.322239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:08.323147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:08.323687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:08.429878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:08.430971 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:08.439719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:08.440441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:08.441433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:08.442042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:08.516658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:08.526794 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fda26d8c-ea07-4ee8-89c4-61730214c043 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.353482 Jul 26 15:10:08.527396 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 376/730] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:08 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:08.628285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:08.636165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-efbc46ff-cf8e-4e75-aee5-a87f5a5840c4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.211689 Jul 26 15:10:08.636763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 355/731] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:08 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:09.049734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:09.050351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:09.056676 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.057099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.057868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.058304 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.193940 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.202052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-52ea72e1-446c-490e-839e-eedeeca419e5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1549 microversion: 2.1 time: 0.156473 Jul 26 15:10:09.202652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 377/732] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:09 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:09.222760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:09.223410 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:09.230225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.230677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.231517 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.231943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.376295 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.384065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-61b0e3ae-907d-4e1e-9632-334e770331d4 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1549 microversion: 2.1 time: 0.165338 Jul 26 15:10:09.384637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 356/733] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:09 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:09.405465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:09.410769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.411560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Searching by: {'deleted': False, 'project_id': 'ee9262c91631413b991af2efeb169cd0'} {{(pid=130762) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 15:10:09.418316 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.418820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.419655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.420092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.510214 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.multi_cell_list [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130762) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 15:10:09.549029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:09.549628 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:09.555862 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.556315 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.557077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.557513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.605831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7b4e1286-eeb1-4499-a3d6-1a4c6c0642d1 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204306 Jul 26 15:10:09.606422 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 378/734] 10.222.0.94 () {58 vars in 1125 bytes} [Tue Jul 26 15:10:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:09.617861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:09.618556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:09.624641 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.625093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.626474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.626943 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.698115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.706777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d39461a3-c2ac-4a50-b63c-3262b2ae75a3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.161641 Jul 26 15:10:09.707380 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 357/735] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:09 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:09.711859 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:09.712456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:09.718655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.719108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.720093 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:09.720534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.768536 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.776150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-549c0bce-1f0b-4d7f-8c3f-236038f3b0d3 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1549 microversion: 2.1 time: 0.162286 Jul 26 15:10:09.776721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 379/736] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:09 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:09.858200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.866069 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fff1b8a4-3358-4bb4-860b-04ca9261404a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.157644 Jul 26 15:10:09.866905 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 358/737] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:09 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:10.728753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:10.737731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:10.737731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:10.737731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:10.737731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:10.738127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:10.870632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:10.880349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-35bbaac9-2227-4f85-b9ec-83371d37778f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.155431 Jul 26 15:10:10.880927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 380/738] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:10 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:10.887756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:10.888374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:10.895141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:10.895624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:10.896422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:10.896860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:11.033710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:11.041452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-89deb105-6f3c-4a4c-8b9c-bb1b01f8e4a6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.157594 Jul 26 15:10:11.042008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 359/739] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:10 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:11.902036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:11.902691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:11.911781 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:11.912144 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:11.912911 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:11.913347 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:12.048984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:12.057301 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5d594119-797d-486b-9ac9-1afafb282740 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.159061 Jul 26 15:10:12.058075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 381/740] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:11 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:12.062721 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:12.064299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:12.071812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:12.072585 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:12.073573 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:12.074226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:12.210322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:12.218084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-83d58570-53a6-4b5e-b991-d18317a11ed3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.159121 Jul 26 15:10:12.218667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 360/741] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:12 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:13.081776 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:13.082382 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:13.088881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:13.089330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:13.090085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:13.090551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:13.226443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:13.234613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-96654791-34a9-45ca-9dca-c60ac2327714 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.156828 Jul 26 15:10:13.236008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 382/742] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:13 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:13.240269 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:13.245760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:13.247993 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:13.248472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:13.249251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:13.249728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:13.254596 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:13.388917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:13.396531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-76b10bab-e057-4968-bbea-7a7308828c2d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.160101 Jul 26 15:10:13.397120 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 361/743] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:13 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:13.992431 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c308856e-0e10-4c27-9b65-638787dfca16"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:13.994798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:14.001328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.001981 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.002852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.003286 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.201611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-0200663b-0cc1-4abd-a085-53233d877aa1 req-da50d994-4d2a-4052-880c-cb762a6d66a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02cbd58-fa78-47f5-ac51-4e1aa930e4f7", "name": "network-vif-plugged", "status": "completed", "tag": "719e7995-4710-47be-a9ec-6331681e1c1f"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:14.213242 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0200663b-0cc1-4abd-a085-53233d877aa1 req-da50d994-4d2a-4052-880c-cb762a6d66a4 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.213677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0200663b-0cc1-4abd-a085-53233d877aa1 req-da50d994-4d2a-4052-880c-cb762a6d66a4 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.225159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-0200663b-0cc1-4abd-a085-53233d877aa1 req-da50d994-4d2a-4052-880c-cb762a6d66a4 service nova] Creating event network-vif-plugged:719e7995-4710-47be-a9ec-6331681e1c1f for instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 on hv-cinder-85066 Jul 26 15:10:14.230944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-0200663b-0cc1-4abd-a085-53233d877aa1 req-da50d994-4d2a-4052-880c-cb762a6d66a4 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Jul 26 15:10:14.231809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 362/744] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:10:14.258812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:14.259584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:14.268563 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.272249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.273290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.273940 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.422285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:14.430631 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-380bde91-d75c-48ce-8bab-63711399f6d0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.176249 Jul 26 15:10:14.431490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 363/745] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:14 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:14.436682 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:14.437301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:14.444230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.444785 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.445565 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.446002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.595200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:14.602898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-65d6cdd3-f858-45ae-a1d2-14333c599e4c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.170221 Jul 26 15:10:14.603497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 364/746] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:14 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:15.044649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8f4b28b6-a254-44eb-bbe7-bce6cbcbe4fc tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056271 Jul 26 15:10:15.051486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 383/747] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:10:13 2022] POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:15.453278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:15.454381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:15.460950 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:15.461395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:15.462153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:15.462586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:15.603195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:15.612100 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6acc0677-5662-4d1b-baff-df6906275671 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.162588 Jul 26 15:10:15.612670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 365/748] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:15 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:15.626338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:15.627390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:15.633677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:15.634119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:15.634873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:15.635301 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:15.776542 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:15.785058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cb6bdadf-2bb5-4265-8d30-033472496966 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1366 microversion: 2.1 time: 0.164014 Jul 26 15:10:15.785644 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 384/749] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:15 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:16.627112 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:16.627663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:16.634363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:16.634991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.635105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:16.635195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.636009 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.636446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.641440 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.642005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.643019 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.643128 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.771784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lazy-loading 'services' on Instance uuid e619d0f5-b226-428e-8e2f-2f876d919fef {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:10:16.787427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:16.795532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-72bb6650-fb8b-40d5-a35b-e057183369c8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.165166 Jul 26 15:10:16.796101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 385/750] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:16 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:16.805809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:16.807686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:16.814201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.814651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.815418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.815892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.963217 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:16.971882 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-79a58937-bdb2-4755-8199-8425053d2144 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1557 microversion: 2.1 time: 0.169523 Jul 26 15:10:16.972840 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 386/751] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:16 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:17.003288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:17.003808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:17.010635 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:17.011087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:17.011896 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:17.012335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:17.072218 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3fe90e9b-27f1-48e8-88c6-ede525cf9d16 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef/os-volume_attachments/b5ba12b8-6c7a-4261-b897-111b29807d90" status: 202 len: 0 microversion: 2.1 time: 0.448853 Jul 26 15:10:17.073045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 366/752] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:10:16 2022] DELETE /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef/os-volume_attachments/b5ba12b8-6c7a-4261-b897-111b29807d90 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:10:17.098814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7ee36a52-c8e2-43fa-88bd-82486ece81cd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099568 Jul 26 15:10:17.100042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 387/753] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:10:16 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:10:17.821663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:17.822384 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:17.824500 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=98 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:17.830990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:17.831220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:17.832057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:17.832498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:18.114015 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:18.123178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cbc544df-6561-4492-aaf3-57fdd9919307 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.307464 Jul 26 15:10:18.123892 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 367/754] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:17 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:18.370330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-121ed364-89e1-4835-b9a4-c3407a4b3719 req-51dcc112-19f1-4f10-b6bf-33e6540b5e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02cbd58-fa78-47f5-ac51-4e1aa930e4f7", "tag": "719e7995-4710-47be-a9ec-6331681e1c1f"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:18.380652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-121ed364-89e1-4835-b9a4-c3407a4b3719 req-51dcc112-19f1-4f10-b6bf-33e6540b5e50 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:18.381238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-121ed364-89e1-4835-b9a4-c3407a4b3719 req-51dcc112-19f1-4f10-b6bf-33e6540b5e50 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:18.392797 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-121ed364-89e1-4835-b9a4-c3407a4b3719 req-51dcc112-19f1-4f10-b6bf-33e6540b5e50 service nova] Creating event network-changed:719e7995-4710-47be-a9ec-6331681e1c1f for instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 on hv-cinder-85066 Jul 26 15:10:18.397851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-121ed364-89e1-4835-b9a4-c3407a4b3719 req-51dcc112-19f1-4f10-b6bf-33e6540b5e50 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033543 Jul 26 15:10:18.398449 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 388/755] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:19.147640 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:19.148288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:19.154992 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:19.155560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:19.156344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:19.156822 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:19.306455 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:19.327824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7bbbcf54-6d8a-472c-ad8c-f8d95c31ac2f tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.172369 Jul 26 15:10:19.327824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 368/756] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:19 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:20.346350 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:20.350601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:20.351712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:20.357520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:20.357967 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:20.358731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:20.359253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:20.495688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:20.504898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-efcbc3b1-730f-43ff-acf5-c0ea5abfdee7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.160388 Jul 26 15:10:20.505392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 389/757] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:20 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:21.526197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:21.526811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:21.533733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:21.534191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:21.534975 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:21.535415 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:21.673469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:21.681701 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-93f8468d-de45-4252-9a0a-b47edd83139e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.159409 Jul 26 15:10:21.682285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 369/758] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:21 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:22.703979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:22.704688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:22.711727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:22.712177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:22.712960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:22.713390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:22.851500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:22.859618 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-17584c83-ada6-4f64-b070-10944375001d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.159814 Jul 26 15:10:22.860951 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 390/759] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:22 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:23.778468 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:23.779074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:23.785754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:23.786202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:23.786972 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:23.787407 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:23.882698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:23.883533 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:23.890174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:23.890704 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:23.891784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:23.892217 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:23.896761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:23.917441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:23.929217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b5298ae4-2645-472e-b23c-cc8c34a6a272 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1595 microversion: 2.1 time: 0.154473 Jul 26 15:10:23.929799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 370/760] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:23 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:24.030532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:24.038696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b96bdd8b-1bb6-490a-a4c0-9489189cc7eb tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.159855 Jul 26 15:10:24.039733 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 391/761] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:23 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:25.063416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:25.064452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:25.070736 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:25.071242 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:25.072094 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:25.072563 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:25.226728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:25.235228 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-74ea97da-3c04-4a3b-a963-e8abcfa50fcf tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.178111 Jul 26 15:10:25.235913 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 371/762] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:25 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:26.257712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:26.258622 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:26.265652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.266638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.267421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.268212 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.414984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:26.423594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-986fbf4b-1156-4ea5-bebe-774531b564c0 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.169511 Jul 26 15:10:26.424180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 392/763] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:26 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:26.530674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-2171ce13-4fe7-4eca-8ec4-e7b1b5dbf38e req-b6359409-7683-47be-887a-6d48378f0778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:26.541888 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-2171ce13-4fe7-4eca-8ec4-e7b1b5dbf38e req-b6359409-7683-47be-887a-6d48378f0778 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.542330 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-2171ce13-4fe7-4eca-8ec4-e7b1b5dbf38e req-b6359409-7683-47be-887a-6d48378f0778 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.553799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-2171ce13-4fe7-4eca-8ec4-e7b1b5dbf38e req-b6359409-7683-47be-887a-6d48378f0778 service nova] Creating event network-changed:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:10:26.559048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-2171ce13-4fe7-4eca-8ec4-e7b1b5dbf38e req-b6359409-7683-47be-887a-6d48378f0778 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032098 Jul 26 15:10:26.559863 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 372/764] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:26.712066 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:26.714352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:26.726662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.727207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.728166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.728769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.760104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:10:27.141425 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5f46ea67-95c4-40e0-8a2b-f02f3e7a5c45 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 204 len: 0 microversion: 2.1 time: 0.433473 Jul 26 15:10:27.142061 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 393/765] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:10:26 2022] DELETE /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:27.151345 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:27.152104 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:27.159442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:27.159923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:27.160784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:27.161258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:27.334658 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:27.343082 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c1b72a55-844e-42c8-b571-0fdf88c6f762 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1514 microversion: 2.1 time: 0.196155 Jul 26 15:10:27.343715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 373/766] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:27 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:27.447032 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:27.448547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:27.462612 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:27.463177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:27.464068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:27.464767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:27.620470 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:27.630256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-06c722d4-0bee-4137-af04-f8fd955c3bc7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.188132 Jul 26 15:10:27.636144 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 394/767] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:27 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:28.364212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:28.364828 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:28.371946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:28.372392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:28.373334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:28.373808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:28.523962 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:28.532407 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-bbbd3a3d-5415-4979-99e1-887f9126dabe tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1514 microversion: 2.1 time: 0.171510 Jul 26 15:10:28.537130 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 374/768] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:28 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:28.651310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:28.651973 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:28.654324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:28.659861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:28.660307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:28.661067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:28.661499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:28.800522 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:28.808770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f21d8249-6a0c-436e-a260-af665faaf0a8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1737 microversion: 2.1 time: 0.161351 Jul 26 15:10:28.809346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 395/769] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:28 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:29.554938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:29.555589 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:29.561847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2132711478"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:29.562371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:29.562513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.562899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.563699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.564184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.569378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.569810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.570607 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.571234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.704226 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.network.security_group_api [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Adding security group 98b1d07f-96c7-443a-8199-36f4c4bf19c9 to port 6d53b356-223b-4f5d-a62b-88f2c5b69216 Jul 26 15:10:29.706265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:29.730763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ea53daa8-dba7-4fe1-97a9-e858471fdbf0 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1514 microversion: 2.1 time: 0.163464 Jul 26 15:10:29.730763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 375/770] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:29 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:29.831085 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:29.831730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:29.837963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.838417 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.839223 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.839701 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.979419 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:29.987760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f4fc9b23-fd3d-43f3-8344-88e5b3b04bc3 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1717 microversion: 2.1 time: 0.161256 Jul 26 15:10:29.989817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 376/771] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:29 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:30.082053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:30.082545 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:30.089097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.093279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.093279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.093279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] HTTP exception thrown: Cannot 'detach_volume' instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 while it is in vm_state rescued Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Request method failure captured: Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments/cb8ff007-87f0-42b8-b51b-7261d3347dc0 HTTP/1.1 Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKkQwkN3TagUDUk9HIaFCgKq5VIVpVl1_6IKGwkUeOUZwhg3tMuoFdBv2bbZaor_FwC0R6DGzOt9R7Ja_jW00cfy9h6j5CTElqBbFyGpf-gK51Hv_9q_KIo60Kqy4qSqMNCjYrN6u1pdxMAUMSoYOT4sLfYzhBP5Svvw3qBb83WRlU Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:10:30.180290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 61b3efca1989483d960b9f92d655d39e Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:10:30.181948 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Cannot 'detach_volume' instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 while it is in vm_state rescued Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'server_id': '530f5891-c2f5-4273-8ef0-c733ef667dc3', 'id': 'cb8ff007-87f0-42b8-b51b-7261d3347dc0'} Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:10:30.182932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 while it is in vm_state rescued Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 while it is in vm_state rescued Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:30.185385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Returning 409 to user: Cannot 'detach_volume' instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 while it is in vm_state rescued {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:10:30.187226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-01e5e801-31c2-4886-848e-feb1e8072a69 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments/cb8ff007-87f0-42b8-b51b-7261d3347dc0" status: 409 len: 152 microversion: 2.1 time: 0.100415 Jul 26 15:10:30.187226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 377/772] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:10:30 2022] DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments/cb8ff007-87f0-42b8-b51b-7261d3347dc0 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 15:10:30.188807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:30.189125 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:30.195824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.196274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.197103 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.197509 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.228600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:30.235704 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f2b5dd3d-8029-4efe-9d14-75bf2f74d030 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/action" status: 202 len: 0 microversion: 2.1 time: 0.677582 Jul 26 15:10:30.236517 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 396/773] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:10:29 2022] POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:10:30.334055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-50ca4489-d558-4b69-a460-f9626e70a305 req-e7b3de45-61a4-457e-8f0c-a0295d32bcbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:30.345231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-50ca4489-d558-4b69-a460-f9626e70a305 req-e7b3de45-61a4-457e-8f0c-a0295d32bcbd service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.352724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-50ca4489-d558-4b69-a460-f9626e70a305 req-e7b3de45-61a4-457e-8f0c-a0295d32bcbd service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.358079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-50ca4489-d558-4b69-a460-f9626e70a305 req-e7b3de45-61a4-457e-8f0c-a0295d32bcbd service nova] Creating event network-changed:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:10:30.364094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-50ca4489-d558-4b69-a460-f9626e70a305 req-e7b3de45-61a4-457e-8f0c-a0295d32bcbd service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123514 Jul 26 15:10:30.365367 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 397/774] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:30.371624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:30.372338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:30.379674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.380380 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.381339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.381779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.465675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-edb4c003-ab22-406b-9a42-6fd4c7bae47a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "POST /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.282533 Jul 26 15:10:30.467029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 378/775] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:10:30 2022] POST /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:10:30.478477 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:30.479253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:30.487157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.487725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.488766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.489459 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.545285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:30.566944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-81751fa9-6df3-4342-aaeb-b5aada2f70fe tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1642 microversion: 2.1 time: 0.198960 Jul 26 15:10:30.569513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 398/776] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:30 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1642 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:30.737542 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:30.739186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:30.747853 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.748808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.749810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.750508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.763696 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:30.782603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-559b734b-f3f8-4110-a775-a66ad6045aad tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1725 microversion: 2.1 time: 0.309498 Jul 26 15:10:30.786577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 379/777] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:30 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:30.942503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:30.952662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9c2adeb5-2c20-48d2-8b5e-c212f69fa213 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1514 microversion: 2.1 time: 0.219918 Jul 26 15:10:30.953498 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 399/778] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:30 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:31.699405 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-ca6743c0-2215-49ec-a540-99f9131336da req-fd154654-a481-45da-94ff-917bb2be6075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e619d0f5-b226-428e-8e2f-2f876d919fef", "name": "network-vif-deleted", "tag": "795cd60f-efea-4474-938b-0fb035fd2965"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:31.710024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-ca6743c0-2215-49ec-a540-99f9131336da req-fd154654-a481-45da-94ff-917bb2be6075 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.711365 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-ca6743c0-2215-49ec-a540-99f9131336da req-fd154654-a481-45da-94ff-917bb2be6075 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:31.731197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-ca6743c0-2215-49ec-a540-99f9131336da req-fd154654-a481-45da-94ff-917bb2be6075 service nova] Creating event network-vif-deleted:795cd60f-efea-4474-938b-0fb035fd2965 for instance e619d0f5-b226-428e-8e2f-2f876d919fef on hv-cinder-85066 Jul 26 15:10:31.731197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-ca6743c0-2215-49ec-a540-99f9131336da req-fd154654-a481-45da-94ff-917bb2be6075 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115368 Jul 26 15:10:31.731197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 380/779] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:31.806559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:31.807195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:31.818442 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.818900 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:31.820578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.821032 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:31.965691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:31.975493 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4c21139b-56fd-48e4-aef7-c00765e6e111 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1725 microversion: 2.1 time: 0.172920 Jul 26 15:10:31.975797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:31.976404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 400/780] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:31 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:31.977699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:31.984973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.985423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:31.986194 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.986826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:32.053149 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:32.060760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-fe5796e4-c808-4b2d-98fb-252a740f3a1f tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1304 microversion: 2.1 time: 0.089297 Jul 26 15:10:32.061329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 381/781] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:31 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:32.996581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:32.997337 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:33.004609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.005050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.005801 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.006228 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.083282 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:33.084313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:33.090591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.091106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.091897 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.092337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.124301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.124753 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.125199 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lazy-loading 'fault' on Instance uuid e619d0f5-b226-428e-8e2f-2f876d919fef {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:10:33.138455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:33.147590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b0583ac0-7d76-4f11-b774-3f6f7452b840 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1725 microversion: 2.1 time: 0.154859 Jul 26 15:10:33.148302 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 401/782] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:32 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:33.168333 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:33.175965 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0044f702-66e4-46fc-9057-fb7feda1d356 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1309 microversion: 2.1 time: 0.097373 Jul 26 15:10:33.176520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 382/783] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:33 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:34.169356 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:34.169965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:34.176637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.177115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.177917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.178459 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.200298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:34.201040 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:34.208439 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.208900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.209669 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.210162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.244483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.244944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.245416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lazy-loading 'fault' on Instance uuid e619d0f5-b226-428e-8e2f-2f876d919fef {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:10:34.291283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb5ce208a2442c2b9b39ac92da6a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87391d9e4bdc48209437f1d786f376c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:34.300427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f5226944-4d1d-4384-901c-302c3d21da55 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 200 len: 1309 microversion: 2.1 time: 0.106021 Jul 26 15:10:34.301209 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 383/784] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:34 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:34.333827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:34.341743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e5480f33-a809-47e0-9ea1-866047b9eac4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1725 microversion: 2.1 time: 0.176258 Jul 26 15:10:34.342314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 402/785] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:34 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:35.322243 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:35.322913 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] [instance: e619d0f5-b226-428e-8e2f-2f876d919fef] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:35.330571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.331023 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.331828 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.332268 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.346107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] HTTP exception thrown: Instance e619d0f5-b226-428e-8e2f-2f876d919fef could not be found. Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Request method failure captured: Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef HTTP/1.1 Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AMH1GlbaOtnG2E4LL-YxDaeRUZ3Y70oRNL9_0I5K0LUPGhblxsCKte6a0ZyNUubrI_MeCjDPeTamBJie_3eFC5BF4c5hIaeVuSs_7p6UOEqkbNNtcDoFGo5HUNsGlT4gPHJ0l2tuFka8SlzDV-pSsDfBZ_WrLV8Tb0Al5PEaeeukII Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 87391d9e4bdc48209437f1d786f376c1 Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1062418878 Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:10:35.347765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/87391d9e4bdc48209437f1d786f376c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-VolumesSnapshotTestJSON-1062418878 Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 87391d9e4bdc48209437f1d786f376c1 Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1062418878 Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-VolumesSnapshotTestJSON-1062418878-project Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 9cb5ce208a2442c2b9b39ac92da6a78e Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-VolumesSnapshotTestJSON-1062418878-project Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance e619d0f5-b226-428e-8e2f-2f876d919fef could not be found. Jul 26 15:10:35.349195 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'e619d0f5-b226-428e-8e2f-2f876d919fef'} Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e619d0f5-b226-428e-8e2f-2f876d919fef could not be found. Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:10:35.349922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e619d0f5-b226-428e-8e2f-2f876d919fef could not be found. Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e619d0f5-b226-428e-8e2f-2f876d919fef could not be found. Jul 26 15:10:35.351492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:10:35.353344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] Returning 404 to user: Instance e619d0f5-b226-428e-8e2f-2f876d919fef could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:10:35.353344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-def4fef3-21f8-4e36-8c73-eeaaa347da02 tempest-VolumesSnapshotTestJSON-1062418878 tempest-VolumesSnapshotTestJSON-1062418878-project] 10.222.0.94 "GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef" status: 404 len: 111 microversion: 2.1 time: 0.030884 Jul 26 15:10:35.353344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 384/786] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:35 2022] GET /compute/v2.1/servers/e619d0f5-b226-428e-8e2f-2f876d919fef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:10:35.363072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:35.363731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:35.370577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.371033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.371834 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.372267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.506143 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:35.514595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-51fa8b2f-e995-4c99-9d5d-aa9506644394 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1731 microversion: 2.1 time: 0.156328 Jul 26 15:10:35.515173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 403/787] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:35 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:35.540613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:35.540613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:35.544393 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.544845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.545626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.546060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.631924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-39a29d3e-1f12-4db0-9335-e0c48591a4b4 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098409 Jul 26 15:10:35.632639 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 385/788] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:10:35 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:36.710475 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-e58cc49f-9970-4afb-9fe9-5b49808f3410 req-1f9967c3-e7ed-4962-adab-5aa8f368e631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530f5891-c2f5-4273-8ef0-c733ef667dc3", "tag": "4f4c8eee-d209-4040-b613-9be1c6f38ffd"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:36.722474 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-e58cc49f-9970-4afb-9fe9-5b49808f3410 req-1f9967c3-e7ed-4962-adab-5aa8f368e631 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:36.723209 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-e58cc49f-9970-4afb-9fe9-5b49808f3410 req-1f9967c3-e7ed-4962-adab-5aa8f368e631 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:36.736989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-e58cc49f-9970-4afb-9fe9-5b49808f3410 req-1f9967c3-e7ed-4962-adab-5aa8f368e631 service nova] Creating event network-changed:4f4c8eee-d209-4040-b613-9be1c6f38ffd for instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 on hv-cinder-85066 Jul 26 15:10:36.744446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-e58cc49f-9970-4afb-9fe9-5b49808f3410 req-1f9967c3-e7ed-4962-adab-5aa8f368e631 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037241 Jul 26 15:10:36.745202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 404/789] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:38.759484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-5fd1568c-0d8a-43fd-8ecb-9e3c88755cec req-d5246b05-1615-48c0-9f35-0abfff6d698c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530f5891-c2f5-4273-8ef0-c733ef667dc3", "tag": "4f4c8eee-d209-4040-b613-9be1c6f38ffd"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:38.769444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5fd1568c-0d8a-43fd-8ecb-9e3c88755cec req-d5246b05-1615-48c0-9f35-0abfff6d698c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:38.769883 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5fd1568c-0d8a-43fd-8ecb-9e3c88755cec req-d5246b05-1615-48c0-9f35-0abfff6d698c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:38.782545 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-5fd1568c-0d8a-43fd-8ecb-9e3c88755cec req-d5246b05-1615-48c0-9f35-0abfff6d698c service nova] Creating event network-changed:4f4c8eee-d209-4040-b613-9be1c6f38ffd for instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 on hv-cinder-85066 Jul 26 15:10:38.788184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-5fd1568c-0d8a-43fd-8ecb-9e3c88755cec req-d5246b05-1615-48c0-9f35-0abfff6d698c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033063 Jul 26 15:10:38.788872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 386/790] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:58.062930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:58.065265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:58.068142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=19 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.068746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.073824 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.074270 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.075129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.075609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.105362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-404848aa-7873-4784-9988-84e3f1fdb703 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047267 Jul 26 15:10:58.105916 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 405/791] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:10:58 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:10:58.170202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:58.170778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:58.173277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=43 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.173924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.179119 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.181765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.181765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.181765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.207877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:10:58.717530 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-bbe0ed2f-42a3-4fc7-949e-835936175b30 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 204 len: 0 microversion: 2.1 time: 0.551077 Jul 26 15:10:58.718108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 387/792] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:10:58 2022] DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:58.726395 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:58.727017 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:58.734717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.735177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.735990 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.736430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.876173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:58.885286 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f38848fd-bf51-49ca-85e3-274b16ac32aa tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1674 microversion: 2.1 time: 0.162679 Jul 26 15:10:58.885812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 406/793] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:58 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:59.907254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:59.911395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:59.914794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:59.915257 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:59.916047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:59.916488 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:00.053656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:00.061536 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9b70da8d-32be-4662-83c4-74c7bd7dc788 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1674 microversion: 2.1 time: 0.159028 Jul 26 15:11:00.062110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 388/794] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:59 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:01.083804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:01.084418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:01.091656 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:01.092414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:01.093192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:01.094189 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:01.231313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:01.239087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0939fe03-52e9-4c53-aeb3-14fe3a74e3c5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1674 microversion: 2.1 time: 0.159259 Jul 26 15:11:01.239706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 407/795] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:01 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:01.660312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-5b7970be-60f8-40ca-b4f5-680d3123e665 req-e26e70dd-d9cb-4665-8b37-153fe1051993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d42296f-f3c6-4b95-999e-7b15b6537bfd", "name": "network-vif-deleted", "tag": "e9809239-4b3d-4ebd-a706-267b3a41b7eb"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:01.678291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5b7970be-60f8-40ca-b4f5-680d3123e665 req-e26e70dd-d9cb-4665-8b37-153fe1051993 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:01.678766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-5b7970be-60f8-40ca-b4f5-680d3123e665 req-e26e70dd-d9cb-4665-8b37-153fe1051993 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:01.695719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-5b7970be-60f8-40ca-b4f5-680d3123e665 req-e26e70dd-d9cb-4665-8b37-153fe1051993 service nova] Creating event network-vif-deleted:e9809239-4b3d-4ebd-a706-267b3a41b7eb for instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd on hv-cinder-85066 Jul 26 15:11:01.702503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-5b7970be-60f8-40ca-b4f5-680d3123e665 req-e26e70dd-d9cb-4665-8b37-153fe1051993 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046490 Jul 26 15:11:01.709506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 389/796] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:02.262032 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:02.262734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:02.271845 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:02.272424 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:02.273276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:02.273775 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:02.307772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:02.308210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:02.308721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lazy-loading 'fault' on Instance uuid 6d42296f-f3c6-4b95-999e-7b15b6537bfd {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:02.350636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:02.358453 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c2a28022-df01-4ec6-b58e-5649178d673b tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 200 len: 1327 microversion: 2.1 time: 0.100407 Jul 26 15:11:02.359757 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 408/797] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:02 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:03.381636 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:03.382543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:03.388656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:03.389117 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:03.389915 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:03.390614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:03.404666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] HTTP exception thrown: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Request method failure captured: Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd HTTP/1.1 Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKgU0K-FjKSHO3ltSrX2WpVww3KvxMsRmDLMkknCHAxrXehaKlnfftKVHIo925_2xywbGTeAB2vpFweP_pIdEQ0L-mYK9ofWAg4bamrZjtEQETSlyDidzjYOxQH-lo2sXq1rtl1seR3S35OIBRgAun-iMpgABzO_lyMVKPEyxiIFHk Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:11:03.406845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_08db5f6552054a6c97ed644366d18b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: a1bc5bf55e9d452b88757ea4080165e0 Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:11:03.408402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '6d42296f-f3c6-4b95-999e-7b15b6537bfd'} Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:03.409297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:11:03.410626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:03.412078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Returning 404 to user: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:03.412078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-891b3bab-832f-497e-8e3a-c6725a324229 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 404 len: 111 microversion: 2.1 time: 0.031389 Jul 26 15:11:03.412078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 390/798] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:03 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:03.419928 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a0f0ef3f-8e31-47a0-9fa6-dc53b8603e68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '.version_select at 0x7f4532adb430>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:03.535949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a0f0ef3f-8e31-47a0-9fa6-dc53b8603e68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933417146" status: 202 len: 0 microversion: 2.1 time: 0.122186 Jul 26 15:11:03.539212 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 409/799] 10.222.0.94 () {58 vars in 1218 bytes} [Tue Jul 26 15:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933417146 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:11:04.424234 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-56154707-9341-45ad-8e73-9971062acd3a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: .version_select at 0x7f4536a38940>, body: {"keypair": {"name": "tempest-keypair-244325593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPijWbbeBwyp6F7besGuo2KUkCS+HrXabZPVIcMDWHtvghTNIIAYlRit+JPI9kqiQ/2vN0ld6pCORopL09NhbiiXXe/0rxVs3O13B3YG2/yRnT5OBNB4gfC/Jxt709Zuw=="}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:04.444183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-56154707-9341-45ad-8e73-9971062acd3a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for project 08db5f6552054a6c97ed644366d18b22. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:11:04.449097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-56154707-9341-45ad-8e73-9971062acd3a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for user a1bc5bf55e9d452b88757ea4080165e0 and project 08db5f6552054a6c97ed644366d18b22. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:11:04.462492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56154707-9341-45ad-8e73-9971062acd3a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [42fb7756-a9ad-4b7a-80c6-20c5f420c872] AMQP server on 10.222.0.94:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:11:05.472143 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [None req-56154707-9341-45ad-8e73-9971062acd3a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [42fb7756-a9ad-4b7a-80c6-20c5f420c872] Reconnected to AMQP server on 10.222.0.94:5672 via [amqp] client with port 37294. Jul 26 15:11:05.553463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-56154707-9341-45ad-8e73-9971062acd3a tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.134779 Jul 26 15:11:05.554068 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 391/800] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:11:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:08.398583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1480154571", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25e10047-eaa5-41ef-808b-1d7621a68610"}], "security_groups": [{"name": "tempest-securitygroup--1635580039"}], "key_name": "tempest-keypair-244325593", "user_data": "}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:08.506376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] validate_networks() for [('25e10047-eaa5-41ef-808b-1d7621a68610', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:11:09.009890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:11:09.010310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:11:09.010788 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:11:09.011255 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:11:09.011703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:11:09.021547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:09.021985 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:09.022823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:09.023254 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:09.040485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for project 08db5f6552054a6c97ed644366d18b22. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:11:09.044478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Getting quotas for user a1bc5bf55e9d452b88757ea4080165e0 and project 08db5f6552054a6c97ed644366d18b22. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:11:09.056954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:11:09.058581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:11:09.215881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d1fd43fc-4655-4875-9e65-dc51adc55f44 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.821663 Jul 26 15:11:09.216530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 410/801] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:11:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:11:09.229568 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-498d7950-3ab3-453d-ac37-33dbaf299f55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:09.230254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-498d7950-3ab3-453d-ac37-33dbaf299f55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:09.292089 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-498d7950-3ab3-453d-ac37-33dbaf299f55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:09.298303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-498d7950-3ab3-453d-ac37-33dbaf299f55 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1237 microversion: 2.1 time: 0.073581 Jul 26 15:11:09.298806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 392/802] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:09 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:10.320180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:10.320739 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:10.328178 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.328608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.329391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.329866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.354265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:10.357664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:10.366927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.367496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.368952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.369404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.395892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:10.403892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-64226d5b-8db4-4a92-9b33-6ca74349c0a5 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1241 microversion: 2.1 time: 0.088337 Jul 26 15:11:10.404470 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 411/803] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:10 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:10.676107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-902c8097-1796-47c7-9c75-cb20d52af460 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/action" status: 202 len: 0 microversion: 2.1 time: 0.326712 Jul 26 15:11:10.676750 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 393/804] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:11:10 2022] POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:11:10.685311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:10.685976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:10.693050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.693501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.694276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.694712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.851615 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:10.860816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9de17457-3deb-401e-aaf9-6675f09698d2 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1753 microversion: 2.1 time: 0.179582 Jul 26 15:11:10.861407 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 412/805] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:10 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:11.426863 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:11.427620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:11.434505 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.434959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:11.435772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.436226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:11.504433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:11.512185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8da45f9f-e20c-4f0f-bebb-7afc48067d6e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1289 microversion: 2.1 time: 0.089757 Jul 26 15:11:11.512833 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 394/806] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:11 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:11.883570 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:11.884305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:11.891577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.891577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:11.897958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.897958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:12.072723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:12.081413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d8584c5f-63a1-4975-a6f0-ffa430469c18 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.201718 Jul 26 15:11:12.091567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 413/807] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:11 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:12.540506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:12.541120 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:12.548594 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:12.549042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:12.549815 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:12.550432 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:12.613766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:12.621655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7d7b6bbc-b3f9-4fcf-ba70-2351a870dabe tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1295 microversion: 2.1 time: 0.085118 Jul 26 15:11:12.622224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 395/808] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:12 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:13.103920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:13.104529 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:13.111866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.112310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.120597 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.120597 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.268917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:13.281883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a4c89584-f537-450a-b381-572f657b3e1a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.181686 Jul 26 15:11:13.282482 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 414/809] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:13 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:13.425575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:13.426261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:13.434445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.434925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.435838 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.436235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.463795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8564e0b7-6c66-4f4c-807f-f36a78102450 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.042655 Jul 26 15:11:13.464773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 396/810] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:11:13 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:13.643531 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:13.644155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:13.650473 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.651127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.651991 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.652429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.792014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:13.801098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-509804e6-63f7-4418-b587-a616691a50c8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.160594 Jul 26 15:11:13.810371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-a3e027b9-9b19-4f25-b7f5-0000996fed9c req-302ee0be-ecb7-4bfe-b3c6-6caad8e2a3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b2bf06-311c-4236-9633-75f06c72444b", "tag": "0795ddd0-1598-416b-bba7-7755c9380123"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:13.818053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 415/811] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:13 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:13.821688 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-a3e027b9-9b19-4f25-b7f5-0000996fed9c req-302ee0be-ecb7-4bfe-b3c6-6caad8e2a3b6 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:13.822216 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-a3e027b9-9b19-4f25-b7f5-0000996fed9c req-302ee0be-ecb7-4bfe-b3c6-6caad8e2a3b6 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:13.837566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-a3e027b9-9b19-4f25-b7f5-0000996fed9c req-302ee0be-ecb7-4bfe-b3c6-6caad8e2a3b6 service nova] Creating event network-changed:0795ddd0-1598-416b-bba7-7755c9380123 for instance a1b2bf06-311c-4236-9633-75f06c72444b on hv-cinder-85066 Jul 26 15:11:13.843796 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-a3e027b9-9b19-4f25-b7f5-0000996fed9c req-302ee0be-ecb7-4bfe-b3c6-6caad8e2a3b6 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036821 Jul 26 15:11:13.844505 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 397/812] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:14.306133 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:14.306743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:14.314584 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:14.315024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:14.315852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:14.316280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:14.493506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:14.503776 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-809b117a-ec78-4fff-94c0-9a707afe2ef7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.201668 Jul 26 15:11:14.510780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 416/813] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:14 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:14.821766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:14.822571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:14.829586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:14.830035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:14.830819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:14.831265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:14.973577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:14.981906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-70380ce5-15eb-4eaa-9af3-eb6d18d852c9 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.164248 Jul 26 15:11:14.982526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 398/814] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:14 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:15.488067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c28f4736-4b87-464c-8da1-0387a66059e6"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:15.490753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:15.497323 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.497762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.498526 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.499504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.526341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:15.526957 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:15.533492 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.533955 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.534906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.535348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.687335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:15.695456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-19d57e8e-caef-4fa1-bb4a-5ed919ed9ed7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.173152 Jul 26 15:11:15.696052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 399/815] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:15 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:16.017591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:16.018260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:16.025016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:16.034502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:16.034502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:16.034502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:16.410694 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:16.418320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4687804f-356f-4be8-aed4-984df72dd706 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.405143 Jul 26 15:11:16.418877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 400/816] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:16 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:16.532591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-215713af-bf21-4fad-88c8-a3b5b903da5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.048653 Jul 26 15:11:16.533371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 417/817] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:11:15 2022] POST /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:16.717628 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:16.718859 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:16.725695 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:16.726157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:16.727496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:16.728693 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:16.880247 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:16.888791 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-76d04328-bcb8-4045-aed6-0c8a87f976f6 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.175470 Jul 26 15:11:16.889371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 401/818] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:16 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:17.441865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:17.442588 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:17.450976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:17.451427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:17.452499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:17.453027 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:17.601390 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:17.610130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7e12bde1-3375-47d6-adc4-80349f0b4923 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.173800 Jul 26 15:11:17.611114 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 418/819] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:17 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:17.910616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:17.911230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:17.919077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:17.919562 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:17.920413 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:17.920864 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.079309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:18.087951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-63df801d-7a02-409d-88e5-80d08ec38a8c tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.181167 Jul 26 15:11:18.088621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 402/820] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:17 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:18.632581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.633193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.641505 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.641963 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.642742 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.643177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.784601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:18.792271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1d49c0a4-9fc5-4bb0-872b-cc3157b397da tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.163526 Jul 26 15:11:18.792839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 419/821] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:18 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:19.110888 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:19.111520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:19.118344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:19.118787 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.119582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:19.120015 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.268100 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:19.276308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d0177ff8-251d-40fb-a462-d7e2f0fb5e56 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.169925 Jul 26 15:11:19.276812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 403/822] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:19 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:19.813823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:19.814457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:19.816403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:19.817098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=6 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:19.822458 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:19.822958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.823754 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:19.824218 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.961123 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:19.968700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-276c69ad-122d-4a05-86cc-51069bdbee39 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.158811 Jul 26 15:11:19.969265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 420/823] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:19 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:20.297467 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=6 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:20.302260 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:20.302878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:20.308950 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:20.309401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:20.310175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:20.310612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:20.467349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:20.476095 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9e4ee3c1-7b5e-466a-9dbb-2d918a5d3c03 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.180179 Jul 26 15:11:20.476932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 404/824] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:20 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:20.671698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-144434e4-d5df-4d8e-baa1-01831e1181b5 req-f1184a2b-3f06-4d1a-9906-1ca70a920202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b2bf06-311c-4236-9633-75f06c72444b", "name": "network-vif-plugged", "status": "completed", "tag": "0795ddd0-1598-416b-bba7-7755c9380123"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:20.681657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-144434e4-d5df-4d8e-baa1-01831e1181b5 req-f1184a2b-3f06-4d1a-9906-1ca70a920202 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:20.682093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-144434e4-d5df-4d8e-baa1-01831e1181b5 req-f1184a2b-3f06-4d1a-9906-1ca70a920202 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:20.694074 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-144434e4-d5df-4d8e-baa1-01831e1181b5 req-f1184a2b-3f06-4d1a-9906-1ca70a920202 service nova] Creating event network-vif-plugged:0795ddd0-1598-416b-bba7-7755c9380123 for instance a1b2bf06-311c-4236-9633-75f06c72444b on hv-cinder-85066 Jul 26 15:11:20.699494 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-144434e4-d5df-4d8e-baa1-01831e1181b5 req-f1184a2b-3f06-4d1a-9906-1ca70a920202 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156976 Jul 26 15:11:20.700121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 421/825] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:20.990977 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:20.991632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:20.998134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:20.998575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:20.999550 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:21.000056 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:21.005428 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.163213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:21.171646 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-925049f1-145b-4eda-a9f0-1b3e116ce82e tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.184250 Jul 26 15:11:21.172224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 405/826] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:20 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:21.500147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:21.500802 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:21.507090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:21.507587 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:21.508327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:21.508756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:21.512910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.657352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:21.665366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c9317bf5-0836-42ca-aa36-b92dfe44660e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.170125 Jul 26 15:11:21.665937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 422/827] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:21 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:22.193565 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:22.194162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:22.200957 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:22.201412 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:22.202720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:22.203160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:22.340486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:22.348607 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3b5b74f4-199e-4f00-bfcb-b6029037575d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.158870 Jul 26 15:11:22.349181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 406/828] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:22 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:22.688261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:22.688883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:22.696085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:22.696526 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:22.697297 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:22.697723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:22.850912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:22.859455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-42fe0e2a-664f-4422-b5e3-617b3a493fa9 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.175890 Jul 26 15:11:22.860113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 423/829] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:22 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:23.370657 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:23.371373 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:23.378844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:23.379296 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:23.380115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:23.380560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:23.522642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:23.530341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-99aa2d46-7e86-467d-abf1-42c0f489f789 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1363 microversion: 2.1 time: 0.163520 Jul 26 15:11:23.530978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 407/830] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:23 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:23.882191 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:23.882799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:23.889977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:23.890480 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:23.891267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:23.891728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.284908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:24.285405 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:24.291378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.291861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.292661 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.293122 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.302258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:24.310757 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-26ad3f36-8bcb-465c-ada4-e4579661de33 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.432374 Jul 26 15:11:24.312284 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 424/831] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:23 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:24.378872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'services' on Instance uuid 530f5891-c2f5-4273-8ef0-c733ef667dc3 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:24.551009 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:24.551700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:24.557784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.558239 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.559160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.559623 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.618580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-678f1931-bfa1-47ce-a690-4c5954010484 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments/cb8ff007-87f0-42b8-b51b-7261d3347dc0" status: 202 len: 0 microversion: 2.1 time: 0.337433 Jul 26 15:11:24.619177 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 408/832] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:11:24 2022] DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments/cb8ff007-87f0-42b8-b51b-7261d3347dc0 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:11:24.629620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:24.632311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:24.639110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.640019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.640799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.641229 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.674126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a3d707b2-3713-4c9c-8305-496d0d317a5d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050110 Jul 26 15:11:24.674703 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 409/833] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:24 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:24.700960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:24.708670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c8feac54-5ebe-44af-93b7-d93afb2927d2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1549 microversion: 2.1 time: 0.161637 Jul 26 15:11:24.709247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 425/834] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:24 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:24.730506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:24.730987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:24.738757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.739205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.740329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:24.740765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:24.821584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-251e2973-4ba4-4f21-917d-431cf35b3256 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095244 Jul 26 15:11:24.822133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 410/835] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:11:24 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:25.154130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c28f4736-4b87-464c-8da1-0387a66059e6"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:25.157624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:25.164371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.164886 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.165803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.166291 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.266432 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Invalid volume: volume c28f4736-4b87-464c-8da1-0387a66059e6 is already attached to instances: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: POST /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments HTTP/1.1 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 74 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:11:25.270865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {"volumeAttachment": {"volumeId": "c28f4736-4b87-464c-8da1-0387a66059e6"}} Jul 26 15:11:25.272464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Invalid volume: volume c28f4736-4b87-464c-8da1-0387a66059e6 is already attached to instances: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'server_id': 'a02cbd58-fa78-47f5-ac51-4e1aa930e4f7', 'body': {'volumeAttachment': {'volumeId': 'c28f4736-4b87-464c-8da1-0387a66059e6'}}} Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c28f4736-4b87-464c-8da1-0387a66059e6 is already attached to instances: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:25.273362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c28f4736-4b87-464c-8da1-0387a66059e6 is already attached to instances: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:25.274579 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c28f4736-4b87-464c-8da1-0387a66059e6 is already attached to instances: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 400 to user: Invalid volume: volume c28f4736-4b87-464c-8da1-0387a66059e6 is already attached to instances: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-99ce73ad-a7f1-4ac9-817d-86b5765c5700 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119793 Jul 26 15:11:25.275993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 426/836] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:11:25 2022] POST /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:11:25.345822 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:25.346037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:25.346497 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:25.346799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:25.352859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.353305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.354080 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.354506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.354714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.355081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.355999 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.356437 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.444881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'services' on Instance uuid a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:25.549304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:25.557627 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6008ddf7-2aa4-4d4a-a3a3-0484963e4a00 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.216668 Jul 26 15:11:25.558204 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 411/837] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:25 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:25.687320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:25.689583 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:25.695811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.699624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.699624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.699624 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.728001 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0bce3c18-7dfb-4d13-8e4f-f1b5481a6355 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments/c28f4736-4b87-464c-8da1-0387a66059e6" status: 202 len: 0 microversion: 2.1 time: 0.386669 Jul 26 15:11:25.728328 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f280f73d-8275-4c69-be3e-22d8ac7c059e tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Jul 26 15:11:25.732215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 427/838] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:11:25 2022] DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments/c28f4736-4b87-464c-8da1-0387a66059e6 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:11:25.732358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 412/839] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:25 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:25.738133 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:25.740883 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:25.747278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.747808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.749237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:25.750044 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:25.782716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8aa73994-e4ad-4392-bb49-35818b744538 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048704 Jul 26 15:11:25.786936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 428/840] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:25 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:26.008853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-777edf76-a05e-47f0-818d-0714a76e5669 req-49e456c1-fe1f-440f-971e-8d9bcc0500b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b2bf06-311c-4236-9633-75f06c72444b", "tag": "0795ddd0-1598-416b-bba7-7755c9380123"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:26.018909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-777edf76-a05e-47f0-818d-0714a76e5669 req-49e456c1-fe1f-440f-971e-8d9bcc0500b8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.019350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-777edf76-a05e-47f0-818d-0714a76e5669 req-49e456c1-fe1f-440f-971e-8d9bcc0500b8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.032458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-777edf76-a05e-47f0-818d-0714a76e5669 req-49e456c1-fe1f-440f-971e-8d9bcc0500b8 service nova] Creating event network-changed:0795ddd0-1598-416b-bba7-7755c9380123 for instance a1b2bf06-311c-4236-9633-75f06c72444b on hv-cinder-85066 Jul 26 15:11:26.037553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-777edf76-a05e-47f0-818d-0714a76e5669 req-49e456c1-fe1f-440f-971e-8d9bcc0500b8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032304 Jul 26 15:11:26.038172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 413/841] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:26.580873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:26.582434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:26.589972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.590422 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.591204 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.591673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.751258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:26.757549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:26.769750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:26.774337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.774860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.775782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.776284 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.787183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-19684d04-772d-4a5a-970b-ef7ee3585042 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.210362 Jul 26 15:11:26.789615 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 429/842] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:26 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:26.809055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:26.812979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:26.821569 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.822862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.823862 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ff4848f4-690f-4b44-9890-92c543582149 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085486 Jul 26 15:11:26.824215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.824910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.831147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 414/843] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:26 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:11:26.865526 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-112de414-3e44-4cc3-86f6-6dd6264b6c72 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061637 Jul 26 15:11:26.868081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 430/844] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:26 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:26.932513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:26.932513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:26.939743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.940324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.941166 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:26.941671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:26.970612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:27.408493 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7282e989-a0a0-45bd-9f54-31c9155d24b6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 204 len: 0 microversion: 2.1 time: 0.480978 Jul 26 15:11:27.409016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 415/845] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:26 2022] DELETE /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:27.418373 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:27.418990 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:27.425872 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.426317 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.427100 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.427566 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.569727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:27.578534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8298ef61-ac03-4ced-b95e-46eebf235697 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1691 microversion: 2.1 time: 0.163918 Jul 26 15:11:27.579108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 431/846] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:27 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:27.813921 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:27.814611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:27.821230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.821678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.822445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.822876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.878718 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:27.880998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:27.887572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.888102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.888942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.889526 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.919502 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-88be7850-1c41-4f6f-8a91-b174e6eaf973 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045308 Jul 26 15:11:27.920074 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 432/847] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:27 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:11:27.971207 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:27.979382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-77ce89d2-dcf4-4a7a-949a-7669b905c01e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.170256 Jul 26 15:11:27.979993 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 416/848] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:27 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:27.984324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:27.985278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:27.991324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.991805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:27.992569 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:27.993004 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:28.018392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:28.344906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5e880bf5-ff40-4799-a121-786b53f425d1 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 204 len: 0 microversion: 2.1 time: 0.365093 Jul 26 15:11:28.345500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 433/849] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:27 2022] DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:28.354025 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:28.354655 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:28.356675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:28.361733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:28.362179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:28.362941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:28.363377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:28.511064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:28.519563 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-76efb503-55d1-4bbe-9210-d0a1491384d3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1681 microversion: 2.1 time: 0.169414 Jul 26 15:11:28.520224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 417/850] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:28 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:28.602589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:28.603290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:28.610034 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:28.610479 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:28.611263 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:28.611720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:28.746722 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:28.755180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-89ec1839-dbe9-43e4-8941-f990ed8285f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1691 microversion: 2.1 time: 0.157480 Jul 26 15:11:28.755789 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 434/851] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:28 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:29.001769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:29.002397 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:29.009877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:29.010352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:29.011126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:29.011590 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:29.158253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:29.166454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8e2692d7-2664-4d7f-8484-02152d5b81b5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.168492 Jul 26 15:11:29.167023 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 418/852] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:28 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:29.541134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:29.541729 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:29.544177 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.549396 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:29.549838 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:29.550601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:29.551039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:29.684431 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:29.692777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d95a80e5-958f-420e-ad00-6f4cd2073ec3 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1681 microversion: 2.1 time: 0.155483 Jul 26 15:11:29.700759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 435/853] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:29 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:29.776945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:29.777560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:29.783712 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:29.784167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:29.784931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:29.785368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:29.919777 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:29.927286 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-abd4e4cb-a614-4c70-b520-11fab284cd49 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1691 microversion: 2.1 time: 0.154243 Jul 26 15:11:29.927875 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 419/854] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:29 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:30.196839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:30.197398 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:30.204160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:30.204611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:30.205625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:30.205890 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:30.224760 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.404677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:30.412620 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-106a6d2e-8dd5-4fac-beaf-a617c517548a tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.220140 Jul 26 15:11:30.413185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 436/855] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:30 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:30.714212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:30.714847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:30.722314 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:30.722755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:30.723669 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:30.724105 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:30.744074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.862474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:30.870659 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b673a71b-c19d-4ade-b843-42b8a4105485 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1681 microversion: 2.1 time: 0.160100 Jul 26 15:11:30.871236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 420/856] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:30 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:30.949221 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:30.949770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:30.957628 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:30.958065 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:30.958831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:30.959367 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:31.093187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:31.100803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ec650391-d5ab-4c4d-ade8-612e67eb3bc6 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1691 microversion: 2.1 time: 0.155613 Jul 26 15:11:31.101376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 437/857] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:30 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:31.434736 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:31.435346 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:31.442277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:31.442848 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:31.443668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:31.444111 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:31.599311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:31.607511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e45a6b73-6207-469c-9fc9-85dc9a013cba tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.176708 Jul 26 15:11:31.613290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 421/858] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:31 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:31.897632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:31.898242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:31.904304 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:31.905300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:31.906064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:31.906495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.037476 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:32.046082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6d7f6c9e-16d7-45c7-9d13-ec3f7f2a586b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1681 microversion: 2.1 time: 0.151440 Jul 26 15:11:32.046651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 438/859] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:31 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:32.122601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:32.123229 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:32.130588 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:32.131035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.131836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:32.132271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.267835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:32.275678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-32354e79-521b-4c45-8d20-fd545fd9a00d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1691 microversion: 2.1 time: 0.156978 Jul 26 15:11:32.276279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 422/860] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:32 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:32.630741 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:32.631378 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:32.637436 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:32.637881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.638649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:32.639328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.791273 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:32.800156 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0a26d856-4b72-4c61-a10c-71c6e5880439 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.173507 Jul 26 15:11:32.800723 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 439/861] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:32 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:33.068003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:33.068605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:33.074486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.074927 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.075704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.076156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.209047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:33.216603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8773c83c-3c22-49f6-9490-b6263773796f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1681 microversion: 2.1 time: 0.152494 Jul 26 15:11:33.217773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 423/862] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:33 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:33.297371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:33.297996 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:33.304634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.305092 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.305846 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.306273 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.440639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:33.448434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bc28178e-f1d1-4c94-8473-0f2c65cfc7be tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1691 microversion: 2.1 time: 0.155093 Jul 26 15:11:33.449105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 440/863] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:33 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:33.822935 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:33.824161 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:33.831535 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.839081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.839081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.839081 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.065752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:34.074008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c03d3f7f-0059-4053-996f-d2c50874c82f tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1758 microversion: 2.1 time: 0.255508 Jul 26 15:11:34.074577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 424/864] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:33 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1758 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:34.239076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:34.240023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:34.249270 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.250702 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.251738 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.252270 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.326311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:34.344426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-97de3a49-e5bb-4786-a72f-8266f59022d2 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1613 microversion: 2.1 time: 0.109192 Jul 26 15:11:34.345510 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 441/865] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:34 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:34.479326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:34.484015 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:34.496519 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.498759 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.506224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.506224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.538026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-9dd6da66-916e-4600-8c82-591e5367d74e req-afc90655-bb30-4839-9ea4-ffab636c2e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530f5891-c2f5-4273-8ef0-c733ef667dc3", "name": "network-vif-deleted", "tag": "4f4c8eee-d209-4040-b613-9be1c6f38ffd"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:34.584902 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-9dd6da66-916e-4600-8c82-591e5367d74e req-afc90655-bb30-4839-9ea4-ffab636c2e7e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.585652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-9dd6da66-916e-4600-8c82-591e5367d74e req-afc90655-bb30-4839-9ea4-ffab636c2e7e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.642313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-9dd6da66-916e-4600-8c82-591e5367d74e req-afc90655-bb30-4839-9ea4-ffab636c2e7e service nova] Creating event network-vif-deleted:4f4c8eee-d209-4040-b613-9be1c6f38ffd for instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 on hv-cinder-85066 Jul 26 15:11:34.648826 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-9dd6da66-916e-4600-8c82-591e5367d74e req-afc90655-bb30-4839-9ea4-ffab636c2e7e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114341 Jul 26 15:11:34.650650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 442/866] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:34.668335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-0a99d058-fcfd-48b0-8079-c267d8ede007 req-bd32c67a-a904-41ee-a514-256e762a707d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02cbd58-fa78-47f5-ac51-4e1aa930e4f7", "name": "network-vif-deleted", "tag": "719e7995-4710-47be-a9ec-6331681e1c1f"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:34.696085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-0a99d058-fcfd-48b0-8079-c267d8ede007 req-bd32c67a-a904-41ee-a514-256e762a707d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.696085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-0a99d058-fcfd-48b0-8079-c267d8ede007 req-bd32c67a-a904-41ee-a514-256e762a707d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.709164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:34.718064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2fbfd37b-33cd-43cc-bb99-7360a4058f9a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1623 microversion: 2.1 time: 0.251086 Jul 26 15:11:34.733420 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 425/867] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:34 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1623 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:34.943053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-0a99d058-fcfd-48b0-8079-c267d8ede007 req-bd32c67a-a904-41ee-a514-256e762a707d service nova] Creating event network-vif-deleted:719e7995-4710-47be-a9ec-6331681e1c1f for instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 on hv-cinder-85066 Jul 26 15:11:34.948933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-0a99d058-fcfd-48b0-8079-c267d8ede007 req-bd32c67a-a904-41ee-a514-256e762a707d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296606 Jul 26 15:11:34.949518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 443/868] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:35.095755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:35.096366 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:35.102541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.102987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.103784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.104212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.276347 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:35.289803 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f33571af-a3ae-4116-b64d-669899572964 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1761 microversion: 2.1 time: 0.197455 Jul 26 15:11:35.290592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 426/869] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:35 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1761 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:35.368312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:35.369736 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:35.377363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.377903 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.378900 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.379327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.417441 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.418137 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.418768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'fault' on Instance uuid a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:35.468207 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:35.476240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c9aa256c-65da-4ce6-b26a-609e0a7f894d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 200 len: 1330 microversion: 2.1 time: 0.113464 Jul 26 15:11:35.477159 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 444/870] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:35 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:35.756397 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:35.757020 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:35.764257 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.764711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.765501 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.765973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.805905 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:35.806656 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.807216 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'fault' on Instance uuid 530f5891-c2f5-4273-8ef0-c733ef667dc3 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:35.860962 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:35.869505 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-afbebc9b-c615-4b2e-85c5-c9cf17200b2a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 200 len: 1335 microversion: 2.1 time: 0.118426 Jul 26 15:11:35.873435 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 427/871] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:35 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:36.498924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:36.499589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:36.506242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:36.506672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:36.507446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:36.507916 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:36.522095 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 HTTP/1.1 Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:11:36.523816 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:11:36.525559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'a02cbd58-fa78-47f5-ac51-4e1aa930e4f7'} Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:36.526652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:11:36.528197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.529857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:36.529857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-efc5eb26-35e0-4e16-849a-dd7f534479dd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 404 len: 111 microversion: 2.1 time: 0.030759 Jul 26 15:11:36.529857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 445/872] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:36 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:36.534867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a965aeb6-0cf5-4802-bbf8-02b331a10b4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '.version_select at 0x7f45369df040>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:36.643387 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a965aeb6-0cf5-4802-bbf8-02b331a10b4e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-254421233" status: 202 len: 0 microversion: 2.1 time: 0.112309 Jul 26 15:11:36.644015 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 428/873] 10.222.0.94 () {58 vars in 1218 bytes} [Tue Jul 26 15:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-254421233 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:11:36.895740 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:36.895740 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: 530f5891-c2f5-4273-8ef0-c733ef667dc3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:36.902191 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:36.902677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:36.903443 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:36.903932 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:36.918701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] HTTP exception thrown: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 could not be found. Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Request method failure captured: Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 HTTP/1.1 Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKkQwkN3TagUDUk9HIaFCgKq5VIVpVl1_6IKGwkUeOUZwhg3tMuoFdBv2bbZaor_FwC0R6DGzOt9R7Ja_jW00cfy9h6j5CTElqBbFyGpf-gK51Hv_9q_KIo60Kqy4qSqMNCjYrN6u1pdxMAUMSoYOT4sLfYzhBP5Svvw3qBb83WRlU Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:11:36.923650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 61b3efca1989483d960b9f92d655d39e Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 could not be found. Jul 26 15:11:36.925339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '530f5891-c2f5-4273-8ef0-c733ef667dc3'} Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 could not be found. Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:36.926223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 could not be found. Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 could not be found. Jul 26 15:11:36.927591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:36.928923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Returning 404 to user: Instance 530f5891-c2f5-4273-8ef0-c733ef667dc3 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:36.928923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d881eef0-e353-4b57-9ac9-689b7820696d tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3" status: 404 len: 111 microversion: 2.1 time: 0.032293 Jul 26 15:11:36.928923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 446/874] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:36 2022] GET /compute/v2.1/servers/530f5891-c2f5-4273-8ef0-c733ef667dc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:36.934767 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-848178c7-5a86-47b7-8081-c3c2999b5ef1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '.version_select at 0x7f45369ffe50>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:37.025952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-848178c7-5a86-47b7-8081-c3c2999b5ef1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683368579" status: 202 len: 0 microversion: 2.1 time: 0.095742 Jul 26 15:11:37.026696 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 429/875] 10.222.0.94 () {58 vars in 1221 bytes} [Tue Jul 26 15:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683368579 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:11:37.570051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9a411162-ce50-40e5-86d9-d5edcc5b5d30 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: .version_select at 0x7f4532841ca0>, body: {"keypair": {"name": "tempest-keypair-1230912853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4/6OgmmnvE8ajgm2aJE8F+ktavg0WPvfX4Bug7QmcTDVuPXTAWsB2+8lzkbYFDqvu9LSUisJatFqMHblDWApZwUj898gqrgegJM27tqUzfgSMJubfsXzTWGepM86RPzg=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:37.593710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-9a411162-ce50-40e5-86d9-d5edcc5b5d30 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:11:37.602966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-9a411162-ce50-40e5-86d9-d5edcc5b5d30 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:11:37.700674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9a411162-ce50-40e5-86d9-d5edcc5b5d30 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134466 Jul 26 15:11:37.701924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 447/876] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:11:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:39.966554 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:39.967534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:39.974625 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:39.975023 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:39.975835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:39.976267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.005113 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lazy-loading 'flavor' on Instance uuid 440d23f7-96c6-46ce-b2ff-147c4070509b {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:40.322590 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9adec566-2090-4c8d-8501-367fa566584d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "POST /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b/action" status: 202 len: 0 microversion: 2.1 time: 0.363168 Jul 26 15:11:40.323721 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 430/877] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:11:39 2022] POST /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:11:40.334995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:40.336349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:40.346567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.347176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.348103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.348881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.515192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:40.523425 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-168c2f9d-8347-49ca-ab17-526f23e21a8c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.194871 Jul 26 15:11:40.524232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 448/878] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:40 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:40.596041 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1457279840", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd3e2f67-4b42-4920-a974-5409190c3fa7"}], "security_groups": [{"name": "tempest-securitygroup--1311317509"}], "key_name": "tempest-keypair-1230912853", "user_data": "}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:40.605337 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:40.606070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:40.613451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.613973 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.615070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.616790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.644942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:40.712606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] validate_networks() for [('bd3e2f67-4b42-4920-a974-5409190c3fa7', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:11:40.979234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7cf3cea0-c0f4-4f3b-a48c-baf49b2240fc tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 204 len: 0 microversion: 2.1 time: 0.378532 Jul 26 15:11:40.979867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 449/879] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:40 2022] DELETE /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:40.989847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:40.990551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:40.997312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.997765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.998588 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.999275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.158901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:41.167330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2db6a18a-ff6e-45f7-8aa9-ed2808cbe9cd tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1508 microversion: 2.1 time: 0.181947 Jul 26 15:11:41.167982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 450/880] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:40 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:41.205377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:11:41.205872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:11:41.206313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:11:41.206721 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:11:41.207165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:11:41.221334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:41.222064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.223067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:41.223529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.242258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:11:41.247389 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Getting quotas for user d2738e8ef94a48bb9a0d6b1177598112 and project 242289f1dedc45ccbdd6aa8e19d4e414. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:11:41.261146 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:11:41.267122 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:11:41.410833 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-eb03a13e-dcd1-4bef-8c0a-b5673ebd84c7 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.819443 Jul 26 15:11:41.411390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 431/881] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:11:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:11:41.422482 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2f67b55b-d3ac-46f9-b737-bfa7a6f5893f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:41.423095 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2f67b55b-d3ac-46f9-b737-bfa7a6f5893f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:41.478822 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2f67b55b-d3ac-46f9-b737-bfa7a6f5893f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:41.487277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2f67b55b-d3ac-46f9-b737-bfa7a6f5893f tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1242 microversion: 2.1 time: 0.068696 Jul 26 15:11:41.488176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 451/882] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:41 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:41.546298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:41.546925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:41.556102 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:41.556532 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.557531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:41.558105 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.705930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:41.714200 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-df8b0608-0a0e-4fd3-bc7b-76da975a3909 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.172440 Jul 26 15:11:41.714822 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 432/883] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:41 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:42.190430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:42.191203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:42.200827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.202199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.202951 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.203380 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.343798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:42.351602 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0db18e45-5b39-4721-a2b1-f0d21757229c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1508 microversion: 2.1 time: 0.165899 Jul 26 15:11:42.352181 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 452/884] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:42 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:42.508582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:42.509157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:42.517858 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.518315 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.519162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.519709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.586560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:42.595271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4ee96649-3de9-4d0b-8a61-6f6af4f8ae9d tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1246 microversion: 2.1 time: 0.090765 Jul 26 15:11:42.595889 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 433/885] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:42 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:42.740355 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:42.740982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:42.747863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.748326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.749090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.749530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.889594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:42.897340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f5e93b48-94a6-47b7-8b2f-899a300b3fca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.161425 Jul 26 15:11:42.897900 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 453/886] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:42 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:43.374290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:43.374836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:43.381280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.381830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.382522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.383727 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.528097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:43.538304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a6051c63-6616-41c8-8870-5385057f00aa tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1508 microversion: 2.1 time: 0.168111 Jul 26 15:11:43.539442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 434/887] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:43 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:43.618813 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:43.620592 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:43.629155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.629708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.630617 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.631353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.666172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-b13c3450-3da4-4558-a22a-c77038f6f2f2 req-21af53e3-d304-4b1d-9279-2cbf1c9e1077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06447f6-a112-4dc5-96aa-87f3189a038e", "name": "network-vif-deleted", "tag": "18c5b7fd-eaad-4eca-8964-f04ead1ce7f7"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:43.683831 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-b13c3450-3da4-4558-a22a-c77038f6f2f2 req-21af53e3-d304-4b1d-9279-2cbf1c9e1077 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.684428 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-b13c3450-3da4-4558-a22a-c77038f6f2f2 req-21af53e3-d304-4b1d-9279-2cbf1c9e1077 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.699075 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-b13c3450-3da4-4558-a22a-c77038f6f2f2 req-21af53e3-d304-4b1d-9279-2cbf1c9e1077 service nova] Creating event network-vif-deleted:18c5b7fd-eaad-4eca-8964-f04ead1ce7f7 for instance c06447f6-a112-4dc5-96aa-87f3189a038e on hv-cinder-85066 Jul 26 15:11:43.704873 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-b13c3450-3da4-4558-a22a-c77038f6f2f2 req-21af53e3-d304-4b1d-9279-2cbf1c9e1077 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046561 Jul 26 15:11:43.707675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 435/888] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:43.715198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:43.724338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f0389d02-9e75-4bb0-bc3b-0722a11eb89a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1294 microversion: 2.1 time: 0.110676 Jul 26 15:11:43.724993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 454/889] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:43 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:43.920877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:43.921483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:43.929129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.929881 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.930867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.931621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.111900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:44.126798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-954cc610-c6a1-45e1-b0ab-2fff0ce5e262 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.210911 Jul 26 15:11:44.127394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 436/890] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:43 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:44.563106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:44.563837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:44.570571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.571110 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.572125 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.572582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.621425 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.621880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.622351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'fault' on Instance uuid c06447f6-a112-4dc5-96aa-87f3189a038e {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:44.628451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.684762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:44.693176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2c130021-a1e3-4910-b3d6-5fd37f4ca2c1 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 200 len: 1312 microversion: 2.1 time: 0.134590 Jul 26 15:11:44.704917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 455/891] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:44 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:44.746068 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:44.746675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:44.754127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.754570 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.755338 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.755790 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.820944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:44.832519 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9b2a6bfe-5000-4eaf-b6b4-eb58a95f3f0c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1312 microversion: 2.1 time: 0.090371 Jul 26 15:11:44.833091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 437/892] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:44 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:45.159439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:45.160510 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:45.173720 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.174438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.175743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.176486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.456523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:45.465478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a2f73e45-ca85-4ea2-a02e-e7306e940052 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.319268 Jul 26 15:11:45.466056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 456/893] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:45 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:45.714404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:45.714920 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: c06447f6-a112-4dc5-96aa-87f3189a038e] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:45.722909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.723361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.724159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.724607 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.728982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:45.741391 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] HTTP exception thrown: Instance c06447f6-a112-4dc5-96aa-87f3189a038e could not be found. Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Request method failure captured: Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e HTTP/1.1 Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKkQwkN3TagUDUk9HIaFCgKq5VIVpVl1_6IKGwkUeOUZwhg3tMuoFdBv2bbZaor_FwC0R6DGzOt9R7Ja_jW00cfy9h6j5CTElqBbFyGpf-gK51Hv_9q_KIo60Kqy4qSqMNCjYrN6u1pdxMAUMSoYOT4sLfYzhBP5Svvw3qBb83WRlU Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:11:45.743078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 61b3efca1989483d960b9f92d655d39e Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance c06447f6-a112-4dc5-96aa-87f3189a038e could not be found. Jul 26 15:11:45.744667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'c06447f6-a112-4dc5-96aa-87f3189a038e'} Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06447f6-a112-4dc5-96aa-87f3189a038e could not be found. Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:45.745466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06447f6-a112-4dc5-96aa-87f3189a038e could not be found. Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06447f6-a112-4dc5-96aa-87f3189a038e could not be found. Jul 26 15:11:45.747304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:11:45.749289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Returning 404 to user: Instance c06447f6-a112-4dc5-96aa-87f3189a038e could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:45.749289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-609fd61c-b765-4bf6-a28e-207b2b727cc8 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e" status: 404 len: 111 microversion: 2.1 time: 0.034098 Jul 26 15:11:45.749289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 438/894] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:45 2022] GET /compute/v2.1/servers/c06447f6-a112-4dc5-96aa-87f3189a038e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:45.754762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:45.755280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:45.762423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.762868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.763770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.764203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.791766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:45.857985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:45.858417 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:45.880422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.880893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.882288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.882288 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.052697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:46.062378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e6cdc862-c345-45d3-b48a-1c032d9960fd tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.208908 Jul 26 15:11:46.063046 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 439/895] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:45 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:46.222663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6c69343c-5b42-49df-93c2-337bb3a3606b tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 204 len: 0 microversion: 2.1 time: 0.471448 Jul 26 15:11:46.227818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 457/896] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:45 2022] DELETE /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:46.240578 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:46.241160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:46.243036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-d46916d7-5465-4894-b06b-1a2963cabe70 req-58418a5f-1fa1-4a6c-b188-d0d70e7f0f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6afb844-0c21-40c3-a0d6-a30adfc2ed23", "tag": "d26cb2f7-8f51-4b59-948e-25c442c7dd79"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:46.253836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.254292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.255117 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.255320 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-d46916d7-5465-4894-b06b-1a2963cabe70 req-58418a5f-1fa1-4a6c-b188-d0d70e7f0f37 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.255719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.255865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-d46916d7-5465-4894-b06b-1a2963cabe70 req-58418a5f-1fa1-4a6c-b188-d0d70e7f0f37 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.269095 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-d46916d7-5465-4894-b06b-1a2963cabe70 req-58418a5f-1fa1-4a6c-b188-d0d70e7f0f37 service nova] Creating event network-changed:d26cb2f7-8f51-4b59-948e-25c442c7dd79 for instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 on hv-cinder-85066 Jul 26 15:11:46.275195 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-d46916d7-5465-4894-b06b-1a2963cabe70 req-58418a5f-1fa1-4a6c-b188-d0d70e7f0f37 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040348 Jul 26 15:11:46.275442 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 458/897] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:46.424360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:46.436692 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-75c5c5d3-11bc-43d5-b460-df9b10d8160a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.207760 Jul 26 15:11:46.437797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 440/898] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:46 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:46.487436 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:46.488257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:46.499410 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.499823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.500612 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.501046 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.651863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:46.660393 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-57c43df8-3966-4245-b2b5-ac5b84017eda tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.177244 Jul 26 15:11:46.660960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 459/899] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:46 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:47.085143 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:47.085814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:47.092944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.093385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.094170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.094990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.240966 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:47.249281 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8d0a1bf3-e542-4c3a-acff-56e6f70df714 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.167925 Jul 26 15:11:47.250556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 441/900] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:47 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:47.458708 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:47.459288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:47.466536 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.467135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.468064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.468500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.609067 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:47.618232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-11021098-d670-4d2a-a2f2-e7d3312ab2f7 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.163532 Jul 26 15:11:47.618806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 460/901] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:47 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:47.682538 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:47.683170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:47.689447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.689906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.690653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.691087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.845641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:47.852711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-157d9633-7cb6-4097-b77f-cffb88c27b6f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.174007 Jul 26 15:11:47.853302 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 442/902] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:47 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:48.272828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:48.273488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:48.281397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.281848 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.282691 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.283121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.432762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:48.442920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c976f314-9e76-4af3-bea1-c29e53e094ec tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.175208 Jul 26 15:11:48.443516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 461/903] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:48 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:48.639853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:48.640425 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:48.647123 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.647614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.648388 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.648821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.789136 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:48.797480 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b6d4e7a7-629a-4acf-8590-ceaf59efcd30 tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.162472 Jul 26 15:11:48.798058 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 443/904] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:48 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:48.876066 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:48.876687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:48.883370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.883853 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.884626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.885060 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:49.025011 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:49.033684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-81b347f2-b9c1-416a-a723-47b1539013f8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.161854 Jul 26 15:11:49.034267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 462/905] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:48 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:49.463667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:49.464465 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:49.471960 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:49.472401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:49.473330 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:49.473839 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:49.667571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:49.681608 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d75aa545-bc66-460c-93f0-e1a4c34620ff tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.221743 Jul 26 15:11:49.691654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 444/906] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:49 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:49.820621 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:49.821793 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:49.828574 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:49.829116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:49.829987 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:49.830488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.057107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:50.058220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:50.066562 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.067128 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.068173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.068699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.292902 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:50.300804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f18ebb7f-ebbf-4554-8518-db0352ba1e0a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1522 microversion: 2.1 time: 0.483955 Jul 26 15:11:50.301384 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 463/907] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:49 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:50.306548 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-110fcbb2-607c-4d66-82a9-3b2f812bd852 req-e103da37-04b8-45c3-ad8b-334b49d2cd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebca4e54-4a78-49e4-b381-6cd1203b3535", "name": "network-vif-deleted", "tag": "0552bdab-a714-4a7a-a202-96df45a02287"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:50.315838 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:50.318167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-110fcbb2-607c-4d66-82a9-3b2f812bd852 req-e103da37-04b8-45c3-ad8b-334b49d2cd68 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.318553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-110fcbb2-607c-4d66-82a9-3b2f812bd852 req-e103da37-04b8-45c3-ad8b-334b49d2cd68 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.324441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c26ea855-667b-4086-9e23-e1488f4d8470 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.271578 Jul 26 15:11:50.325049 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 445/908] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:50 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:50.331165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-110fcbb2-607c-4d66-82a9-3b2f812bd852 req-e103da37-04b8-45c3-ad8b-334b49d2cd68 service nova] Creating event network-vif-deleted:0552bdab-a714-4a7a-a202-96df45a02287 for instance ebca4e54-4a78-49e4-b381-6cd1203b3535 on hv-cinder-85066 Jul 26 15:11:50.342362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-110fcbb2-607c-4d66-82a9-3b2f812bd852 req-e103da37-04b8-45c3-ad8b-334b49d2cd68 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039072 Jul 26 15:11:50.343044 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 464/909] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:50.704826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:50.705436 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:50.712188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.712646 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.713429 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.713874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.852219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:50.859905 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-536a9709-dbf6-4995-b1f5-e33566ecb67e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.159441 Jul 26 15:11:50.860497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 446/910] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:50 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:51.324841 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:51.325548 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:51.332192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.332639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.333451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.333885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.348452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:51.349067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:51.350951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:51.351663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=6 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:51.356638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.357788 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.364311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.364311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.409550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:51.419283 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a893295a-7aaf-41e3-9417-dfd4ad3c60ce tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1307 microversion: 2.1 time: 0.098855 Jul 26 15:11:51.420875 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 465/911] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:51 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:51.518684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:51.526928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-bcb9b6b9-cfd6-4aa8-a08b-ed1c601d75b7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.182501 Jul 26 15:11:51.530316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 447/912] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:51 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:51.881869 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:51.882496 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:51.884557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=6 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:51.890418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.890712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.891520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.891963 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.027516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:52.035410 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b22587c0-568f-41be-ab83-c955eea5a410 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.157448 Jul 26 15:11:52.036036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 466/913] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:51 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:52.444575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:52.446245 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:52.453958 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.455386 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.455386 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.456170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.498140 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.498609 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.499576 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lazy-loading 'fault' on Instance uuid ebca4e54-4a78-49e4-b381-6cd1203b3535 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:52.549752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3efca1989483d960b9f92d655d39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe01616efc64d2e901f45662e7c3518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:52.551732 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:52.553219 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:52.559163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b4122e38-297a-4215-adf8-0fed3ff64e6c tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 200 len: 1312 microversion: 2.1 time: 0.118894 Jul 26 15:11:52.560921 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 448/914] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:52 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:52.564276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.565096 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.566523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.567250 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.722709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:52.735660 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fab47d3b-805c-43f2-b6a3-a7407e1e649b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.189269 Jul 26 15:11:52.736257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 467/915] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:52 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:53.057222 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:53.057869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:53.065004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.065455 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.066226 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.066670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.216894 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:53.225361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-668773eb-7383-4e90-ba88-e58d5933b48e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.172131 Jul 26 15:11:53.225936 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 449/916] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:53 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:53.585272 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:53.585885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] [instance: ebca4e54-4a78-49e4-b381-6cd1203b3535] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:53.593646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.594101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.594884 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.595327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.610204 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] HTTP exception thrown: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 could not be found. Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Request method failure captured: Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 HTTP/1.1 Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKkQwkN3TagUDUk9HIaFCgKq5VIVpVl1_6IKGwkUeOUZwhg3tMuoFdBv2bbZaor_FwC0R6DGzOt9R7Ja_jW00cfy9h6j5CTElqBbFyGpf-gK51Hv_9q_KIo60Kqy4qSqMNCjYrN6u1pdxMAUMSoYOT4sLfYzhBP5Svvw3qBb83WRlU Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:11:53.611929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/dbe01616efc64d2e901f45662e7c3518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: dbe01616efc64d2e901f45662e7c3518 Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190978010 Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 61b3efca1989483d960b9f92d655d39e Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190978010-project Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 could not be found. Jul 26 15:11:53.614070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'ebca4e54-4a78-49e4-b381-6cd1203b3535'} Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 could not be found. Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:53.614819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 could not be found. Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 could not be found. Jul 26 15:11:53.616130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:11:53.617238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] Returning 404 to user: Instance ebca4e54-4a78-49e4-b381-6cd1203b3535 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:53.617238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-08394e53-e79e-4560-98ec-c0c2136fb81a tempest-ServerRescueNegativeTestJSON-190978010 tempest-ServerRescueNegativeTestJSON-190978010-project] 10.222.0.94 "GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535" status: 404 len: 111 microversion: 2.1 time: 0.032103 Jul 26 15:11:53.617238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 468/917] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:53 2022] GET /compute/v2.1/servers/ebca4e54-4a78-49e4-b381-6cd1203b3535 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:53.758463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:53.759022 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:53.767178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.767702 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.768412 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.769439 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.003715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:54.012509 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4ad8b3cd-2277-44a4-a8e5-7a41953ee25c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.257846 Jul 26 15:11:54.013649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 450/918] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:53 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:54.250490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:54.251448 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:54.258876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.259327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.260226 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.260658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.551716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:54.560974 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-29f21961-32ce-447c-85e9-def1345ede5a tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.316425 Jul 26 15:11:54.562508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 469/919] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:54 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:54.733804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-124e4631-61e4-4427-9879-009c8511adcc req-05c18219-f3fc-4de8-8b0d-305684a4aaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6afb844-0c21-40c3-a0d6-a30adfc2ed23", "name": "network-vif-plugged", "status": "completed", "tag": "d26cb2f7-8f51-4b59-948e-25c442c7dd79"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:54.748737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-124e4631-61e4-4427-9879-009c8511adcc req-05c18219-f3fc-4de8-8b0d-305684a4aaf3 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.748998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-124e4631-61e4-4427-9879-009c8511adcc req-05c18219-f3fc-4de8-8b0d-305684a4aaf3 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.762652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-124e4631-61e4-4427-9879-009c8511adcc req-05c18219-f3fc-4de8-8b0d-305684a4aaf3 service nova] Creating event network-vif-plugged:d26cb2f7-8f51-4b59-948e-25c442c7dd79 for instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 on hv-cinder-85066 Jul 26 15:11:54.768351 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-124e4631-61e4-4427-9879-009c8511adcc req-05c18219-f3fc-4de8-8b0d-305684a4aaf3 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045023 Jul 26 15:11:54.769192 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 451/920] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:55.036759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:55.038154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:55.046374 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:55.046823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:55.047639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:55.048080 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:55.325269 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:55.334901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7a151b19-ea62-43f6-9cee-2ed4ad8bd99b tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.302418 Jul 26 15:11:55.341175 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 470/921] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:55 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:55.586227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:55.586929 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:55.594065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:55.594938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:55.595752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:55.596339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:55.834448 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:55.842760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a2bb217c-b3b5-4afb-9716-66b8c1b96e26 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.262609 Jul 26 15:11:55.843427 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 452/922] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:55 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:56.362427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:56.363099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:56.369653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.374673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.375120 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.376021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.376614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.529564 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:56.537632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-594ddd0b-de1e-4226-8c16-12f564d7dd44 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.179163 Jul 26 15:11:56.538264 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 471/923] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:56 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:56.866666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:56.867490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:56.877084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.878103 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.879726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.880165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:57.138293 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:57.146585 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5ff03282-e3ba-4342-a804-36470f2f2f46 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1368 microversion: 2.1 time: 0.283936 Jul 26 15:11:57.147188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 453/924] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:56 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:57.562098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:57.562692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:57.579385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:57.579865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:57.580653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:57.581084 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:57.603880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.835555 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:57.844852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e847a333-23e4-4a31-a07d-a990248534da tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.288144 Jul 26 15:11:57.845435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 472/925] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:57 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:58.167699 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.169148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.177255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.177941 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.179091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.179766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.335221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:58.338522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-08ed6c36-5e27-4ab5-87c7-66aa4196491c tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1558 microversion: 2.1 time: 0.175063 Jul 26 15:11:58.339111 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 454/926] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:58.361111 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.364151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.373553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.373553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.373553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.373553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.452313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2ce4fb3a-db86-40cf-9648-688cca73c0ee tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096881 Jul 26 15:11:58.455936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 473/927] 10.222.0.94 () {58 vars in 1275 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:58.868393 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.869319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.871571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.880522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.881352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.882630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.883652 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.032261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:59.046298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.046298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d2b034b2-c08d-42b1-a7d0-cf990c2318b4 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.176997 Jul 26 15:11:59.046298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 455/928] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:59.606683 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-40005fc9-b972-4861-a7f6-e4fd4460545b req-ec26015d-6b6a-44e4-8d94-4dc599a19471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6afb844-0c21-40c3-a0d6-a30adfc2ed23", "tag": "d26cb2f7-8f51-4b59-948e-25c442c7dd79"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:59.617622 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-40005fc9-b972-4861-a7f6-e4fd4460545b req-ec26015d-6b6a-44e4-8d94-4dc599a19471 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.618055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-40005fc9-b972-4861-a7f6-e4fd4460545b req-ec26015d-6b6a-44e4-8d94-4dc599a19471 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.632586 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-40005fc9-b972-4861-a7f6-e4fd4460545b req-ec26015d-6b6a-44e4-8d94-4dc599a19471 service nova] Creating event network-changed:d26cb2f7-8f51-4b59-948e-25c442c7dd79 for instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 on hv-cinder-85066 Jul 26 15:11:59.639176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-40005fc9-b972-4861-a7f6-e4fd4460545b req-ec26015d-6b6a-44e4-8d94-4dc599a19471 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037647 Jul 26 15:11:59.639845 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 474/929] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:00.067616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:00.069239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:00.087358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:00.090945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:00.090945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:00.090945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:00.313154 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:00.321444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d2eedb32-414b-4dec-8beb-339f72be624c tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.263037 Jul 26 15:12:00.322389 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 456/930] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:00 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:01.347058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:01.350847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:01.354681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:01.355912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:01.356733 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:01.357203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:01.523277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:01.532620 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-da17e518-e201-49a7-a1e8-72b273c844e3 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.190489 Jul 26 15:12:01.533200 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 475/931] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:01 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:02.557308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:02.558295 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:02.572523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.572523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.572523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.572523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.712313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:02.720889 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-19db6fb5-a788-489e-9156-5db769a01d4d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1509 microversion: 2.1 time: 0.169979 Jul 26 15:12:02.721462 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 457/932] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:02 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:02.745732 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:02.746308 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:02.752799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.753237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.753998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.754430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.061244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7b409562-68b5-493d-9a1c-e05e8d6b196d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "POST /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b/action" status: 202 len: 0 microversion: 2.1 time: 0.319335 Jul 26 15:12:03.062679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 476/933] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:12:02 2022] POST /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:03.070596 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:03.071274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:03.079096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:03.079758 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.081107 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:03.081780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.285155 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:03.296930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1b294a4a-babb-442a-84bb-0bb9b8998f1f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1517 microversion: 2.1 time: 0.229971 Jul 26 15:12:03.297999 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 458/934] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:03 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:04.326003 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:04.326675 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:04.334203 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:04.334728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:04.335898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:04.336617 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:04.602157 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:04.614052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-afb5dd0a-e3e1-4d75-a355-a638b3765f69 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1517 microversion: 2.1 time: 0.293089 Jul 26 15:12:04.615087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 477/935] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:04 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1517 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:04.750179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-2a4d4885-29b0-43f8-9f55-7fdd0739329c req-906002ea-0115-4e4d-a2ea-f7895ed0a172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "name": "network-vif-unplugged", "status": "completed", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:04.769477 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-2a4d4885-29b0-43f8-9f55-7fdd0739329c req-906002ea-0115-4e4d-a2ea-f7895ed0a172 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:04.770172 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-2a4d4885-29b0-43f8-9f55-7fdd0739329c req-906002ea-0115-4e4d-a2ea-f7895ed0a172 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:04.783336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.compute.server_external_events [req-2a4d4885-29b0-43f8-9f55-7fdd0739329c req-906002ea-0115-4e4d-a2ea-f7895ed0a172 service nova] Unable to find a host for instance 440d23f7-96c6-46ce-b2ff-147c4070509b. Dropping event network-vif-unplugged {{(pid=130764) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 15:12:04.784265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-2a4d4885-29b0-43f8-9f55-7fdd0739329c req-906002ea-0115-4e4d-a2ea-f7895ed0a172 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040865 Jul 26 15:12:04.785464 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 459/936] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 15:12:05.640893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:05.642372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:05.652021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:05.652812 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:05.658183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:05.658183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:05.854326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:05.881488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c524feb0-dd07-49ba-b0d3-ae1624d09834 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1519 microversion: 2.1 time: 0.245101 Jul 26 15:12:05.895507 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 478/937] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:05 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:06.906338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:06.907253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:06.913466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:06.914171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:06.915176 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:06.915828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:06.956341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-93105a19-f6e9-44dd-b33e-1ae380559176 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'create', calling method: .version_select at 0x7f4536971430>, body: {"keypair": {"name": "tempest-keypair-824095577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG18ImC7/7M6BH5HVi5Pfvrp4RyVW5yPRY2qgUhorqJQPB1LyiDZhHZlN/QgHG0dNKubdGkoJ/tMDPytXOKJ3Lr5Y++vFj69KiYTMJMBgBNzkY75WneuSUA8y8F5Gi3xNw=="}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:06.972860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-93105a19-f6e9-44dd-b33e-1ae380559176 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for project b57441fed5b5437581930346bf9116ef. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:12:06.977472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-93105a19-f6e9-44dd-b33e-1ae380559176 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for user b7e467910de54b7ea55cb2d728a8c9be and project b57441fed5b5437581930346bf9116ef. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:12:07.073191 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:07.081599 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-60428f51-f9cf-49a7-a977-89f675ecfdca tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.180072 Jul 26 15:12:07.096139 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 479/938] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:06 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:07.134429 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-93105a19-f6e9-44dd-b33e-1ae380559176 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.263483 Jul 26 15:12:07.137071 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 460/939] 10.222.0.94 () {62 vars in 1200 bytes} [Tue Jul 26 15:12:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 267 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:08.105252 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:08.105872 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:08.112940 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:08.113632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:08.114520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:08.114919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:08.296372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:08.304729 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-baded539-da3d-4111-9aeb-f10fdbfae043 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.203343 Jul 26 15:12:08.305328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 480/940] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:08 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:09.333236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:09.334464 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:09.342214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:09.342859 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:09.343665 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:09.344291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:09.556304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:09.561875 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-83750547-91fc-4f0b-ad8c-dee2daeaf888 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.232883 Jul 26 15:12:09.562457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 461/941] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:09 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:09.823156 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1769051235", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12e3290f-127b-470c-b462-095d0a9eadf0"}], "security_groups": [{"name": "tempest-securitygroup--325672630"}], "key_name": "tempest-keypair-824095577", "user_data": "}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:09.965303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] validate_networks() for [('12e3290f-127b-470c-b462-095d0a9eadf0', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:12:10.452438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:12:10.453666 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:12:10.454209 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:12:10.461369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:12:10.461369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:12:10.465215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.466452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.467396 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.467807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.487753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for project b57441fed5b5437581930346bf9116ef. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:12:10.492488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for user b7e467910de54b7ea55cb2d728a8c9be and project b57441fed5b5437581930346bf9116ef. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:12:10.506855 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:12:10.510757 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:12:10.584866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:10.589616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:10.593074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.593569 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.594297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.594730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.645121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-704215fc-1d5f-4e2d-bcef-7fd76490386e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.826940 Jul 26 15:12:10.645781 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 481/942] 10.222.0.94 () {62 vars in 1188 bytes} [Tue Jul 26 15:12:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 15:12:10.660102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-523f31b0-e9e2-4eaa-84b8-0013ac51465d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:10.660862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-523f31b0-e9e2-4eaa-84b8-0013ac51465d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:10.726964 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-523f31b0-e9e2-4eaa-84b8-0013ac51465d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:10.736238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-523f31b0-e9e2-4eaa-84b8-0013ac51465d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:10.738594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-523f31b0-e9e2-4eaa-84b8-0013ac51465d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:10.740022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-523f31b0-e9e2-4eaa-84b8-0013ac51465d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1281 microversion: 2.20 time: 0.086794 Jul 26 15:12:10.741028 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 482/943] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:10 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:12:11.012435 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:11.021469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-700866d2-e266-45c0-a035-0d445b7f1f6a tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.440489 Jul 26 15:12:11.022051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 462/944] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:10 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:11.763678 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:11.764253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:11.770992 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:11.771420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:11.772247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:11.772677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:11.838437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:11.847035 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:11.848589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:11.849693 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ec69668c-b2c1-4540-baea-0270cd9cc53b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1285 microversion: 2.20 time: 0.091309 Jul 26 15:12:11.850285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 483/945] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:11 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:12.044539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:12.044539 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:12.052024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:12.052484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:12.053275 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:12.053714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:12.195560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:12.204180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d114a00b-4525-4c13-8ad9-e1149fee9f75 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.165134 Jul 26 15:12:12.204755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 463/946] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:12 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:12.873765 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:12.874610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:12.881484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:12.881937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:12.882721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:12.883157 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:12.946817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:12.955559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:12.957097 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:12.958251 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-841dd6ba-d0e3-453b-b8e9-ec2303e516fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1333 microversion: 2.20 time: 0.089515 Jul 26 15:12:12.958783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 484/947] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:12 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:13.226709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:13.227320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:13.234575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.235024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.235834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.236299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.399679 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:13.408770 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8f091156-52bc-42d2-ada5-75aef2d6f5a8 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.185990 Jul 26 15:12:13.413998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 464/948] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:13 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:13.749359 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:13.749766 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:13.755842 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.756292 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.757051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.758347 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.780669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9fa764c8-8d75-487d-95ce-9de680413b06 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/ips" status: 200 len: 146 microversion: 2.1 time: 0.035776 Jul 26 15:12:13.781243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 485/949] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:12:13 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:13.981718 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:13.982491 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:13.989143 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.989596 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.990377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.990819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:14.055376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:14.063913 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:14.065433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:14.066541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-84708ada-75ab-46aa-954b-7a72ba7e5391 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1339 microversion: 2.20 time: 0.089310 Jul 26 15:12:14.067180 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 465/950] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:13 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:14.430256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:14.430840 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:14.438227 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:14.438671 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:14.439449 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:14.439906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:14.582525 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:14.590539 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-28d0db11-5702-4961-899c-6ba9ae69c1a2 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.163953 Jul 26 15:12:14.591173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 486/951] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:14 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:15.093075 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:15.094338 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:15.104776 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:15.105231 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.107150 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:15.107922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.321282 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:15.330483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:15.332019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:15.333213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-31b1b222-c545-4787-81de-44fcb863dedf tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.247208 Jul 26 15:12:15.333787 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 466/952] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:15 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:15.410008 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d4f5b5c-c711-4390-b940-4c00826ec2a5"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:15.412576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:15.428885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:15.428885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.428885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:15.428885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.613533 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:15.614148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:15.620691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:15.621146 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.622698 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:15.623912 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.870440 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:15.881947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-69076379-5eb9-41af-98d8-2356e932d247 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.272761 Jul 26 15:12:15.882883 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 467/953] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:15 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:16.129372 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-83399d8e-defe-4127-8792-937085df1edf req-9c7d273c-9c79-43c8-912f-33876a402f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:16.156356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-83399d8e-defe-4127-8792-937085df1edf req-9c7d273c-9c79-43c8-912f-33876a402f51 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:16.156356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-83399d8e-defe-4127-8792-937085df1edf req-9c7d273c-9c79-43c8-912f-33876a402f51 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:16.164863 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-83399d8e-defe-4127-8792-937085df1edf req-9c7d273c-9c79-43c8-912f-33876a402f51 service nova] Creating event network-changed:914aac9d-0f65-4fef-a9cf-7ea754b0fa1d for instance 16ce9439-b753-41cb-a9b1-042db35be70b on hv-cinder-85066 Jul 26 15:12:16.170414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-83399d8e-defe-4127-8792-937085df1edf req-9c7d273c-9c79-43c8-912f-33876a402f51 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046170 Jul 26 15:12:16.171062 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 468/954] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:16.333806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9d0ec8cb-0817-44e0-9a85-9f1183b9d2c2 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.925091 Jul 26 15:12:16.333806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 487/955] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:12:15 2022] POST /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:16.359522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:16.360280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:16.368357 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:16.369027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:16.369966 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:16.370496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:16.601643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:16.615378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:16.617518 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:16.619305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b575964e-5149-46cf-b140-c553ee44ad1d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.266502 Jul 26 15:12:16.623339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 469/956] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:16 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:16.907381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:16.908492 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:16.916913 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:16.917361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:16.918856 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:16.919828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:17.068768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:17.078902 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-370b03f4-9e49-46ea-922c-5c38c29ee4af tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.178549 Jul 26 15:12:17.079520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 488/957] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:16 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:17.644911 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:17.645469 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:17.647309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=4 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:17.653287 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:17.653737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:17.654498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:17.654925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:17.789809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:17.797905 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:17.799431 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:17.800559 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f7a54fbf-cd3a-429f-8b3c-750f85c377a6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.159646 Jul 26 15:12:17.801115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 470/958] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:17 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:18.100353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:18.100948 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:18.108242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:18.108686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:18.109444 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:18.109874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:18.244876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:18.248710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.253150 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-59f21926-f807-4cff-ae39-5afd1196ae5f tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.156747 Jul 26 15:12:18.253711 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 489/959] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:18 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:18.723637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-fc421f31-100f-4c24-96a4-775da5460f3d req-f92af401-ec44-4fa3-b755-96747c42a5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "name": "network-vif-plugged", "status": "completed", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:18.730348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-fc421f31-100f-4c24-96a4-775da5460f3d req-f92af401-ec44-4fa3-b755-96747c42a5b2 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:18.730879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-fc421f31-100f-4c24-96a4-775da5460f3d req-f92af401-ec44-4fa3-b755-96747c42a5b2 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:18.742561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-fc421f31-100f-4c24-96a4-775da5460f3d req-f92af401-ec44-4fa3-b755-96747c42a5b2 service nova] Creating event network-vif-plugged:79dc17dd-0f41-4a9f-9307-9de726b3d06e for instance 440d23f7-96c6-46ce-b2ff-147c4070509b on hv-cinder-85066 Jul 26 15:12:18.748051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-fc421f31-100f-4c24-96a4-775da5460f3d req-f92af401-ec44-4fa3-b755-96747c42a5b2 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031713 Jul 26 15:12:18.748838 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 471/960] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:18.823892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:18.825104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:18.831501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:18.831980 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:18.832756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:18.833193 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:18.983411 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:18.994244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:18.995823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:18.997893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4a01f86a-644c-4719-8af6-0a809da81630 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.178206 Jul 26 15:12:18.998524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 490/961] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:18 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:19.281537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:19.282239 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:19.288999 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:19.290059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:19.290636 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:19.291088 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:19.455837 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:19.463746 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4115d036-23d4-434f-a504-1f574cc1a562 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.187335 Jul 26 15:12:19.464330 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 472/962] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:19 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:20.025618 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:20.026227 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:20.033057 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:20.033510 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:20.034327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:20.034771 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:20.174725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:20.182750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:20.185105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:20.186231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f0c3a2bc-7b9e-4b81-817a-4a1b04708791 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.164764 Jul 26 15:12:20.186836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 491/963] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:20 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:20.487092 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:20.487658 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:20.494571 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:20.495017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:20.495816 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:20.497028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:20.635150 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:20.652187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-431f21db-f192-46fd-9366-3dc170135aa9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1575 microversion: 2.1 time: 0.168975 Jul 26 15:12:20.653027 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 473/964] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:20 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:21.211971 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:21.212567 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:21.214383 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.215771 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=8 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.221206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:21.221652 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:21.222423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:21.222858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:21.358869 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:21.367683 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:21.369243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:21.370629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0bea60a8-05f7-490b-a38e-0e0e1e960815 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.162704 Jul 26 15:12:21.371269 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 492/965] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:21 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:21.676115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:21.676761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:21.683520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:21.684471 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:21.685253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:21.686057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:21.824070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:21.832360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-47db7294-72b3-48e8-8ef6-de6c72567dd7 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1562 microversion: 2.1 time: 0.160194 Jul 26 15:12:21.832933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 474/966] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:21 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:22.393789 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:22.394458 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:22.401056 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:22.401507 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:22.402312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:22.403383 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:22.545406 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:22.553820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:22.555331 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:22.556559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f13e4420-2e41-497a-ae6b-1904ee40d50f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.166725 Jul 26 15:12:22.557111 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 493/967] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:22 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:22.826513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-0a595dbf-ec56-45ef-b245-ceca2b13bab6 req-0a1ca99f-2efc-4523-bd43-3a5286ec378d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "name": "network-vif-plugged", "status": "completed", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:22.837038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0a595dbf-ec56-45ef-b245-ceca2b13bab6 req-0a1ca99f-2efc-4523-bd43-3a5286ec378d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:22.837487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0a595dbf-ec56-45ef-b245-ceca2b13bab6 req-0a1ca99f-2efc-4523-bd43-3a5286ec378d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:22.850413 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-0a595dbf-ec56-45ef-b245-ceca2b13bab6 req-0a1ca99f-2efc-4523-bd43-3a5286ec378d service nova] Creating event network-vif-plugged:914aac9d-0f65-4fef-a9cf-7ea754b0fa1d for instance 16ce9439-b753-41cb-a9b1-042db35be70b on hv-cinder-85066 Jul 26 15:12:22.855267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-0a595dbf-ec56-45ef-b245-ceca2b13bab6 req-0a1ca99f-2efc-4523-bd43-3a5286ec378d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 Jul 26 15:12:22.856159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 475/968] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:23.580435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:23.580989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:23.587637 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:23.588093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:23.588865 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:23.589307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:23.720836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:23.728859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:23.730425 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:23.731670 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c4221f30-e7ee-4130-94fa-08eac6750a08 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.155360 Jul 26 15:12:23.732234 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 494/969] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:23 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:24.756751 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:24.757451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:24.764697 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:24.765603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:24.765932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:24.766352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:24.768484 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2132711478"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:24.769103 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:24.771175 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=100 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:24.776290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:24.776739 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:24.778804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:24.779275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:24.920924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:24.931342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:24.932910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:24.934070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-41f553bc-3751-40c0-b3a2-f805eb85292a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1406 microversion: 2.20 time: 0.182297 Jul 26 15:12:24.934642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 476/970] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:24 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:24.935748 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.network.security_group_api [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Removing security group 98b1d07f-96c7-443a-8199-36f4c4bf19c9 from port 6d53b356-223b-4f5d-a62b-88f2c5b69216 Jul 26 15:12:25.485147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-69b72b18-a111-4696-b6ed-90d094ae0811 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/action" status: 202 len: 0 microversion: 2.1 time: 0.720616 Jul 26 15:12:25.486244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 495/971] 10.222.0.94 () {60 vars in 1278 bytes} [Tue Jul 26 15:12:24 2022] POST /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:12:25.502884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-ba623715-bf96-45d4-afd1-10b47b7abfd4 req-3d86018b-2ffe-4eac-aa63-c980452e6a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:25.519555 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-ba623715-bf96-45d4-afd1-10b47b7abfd4 req-3d86018b-2ffe-4eac-aa63-c980452e6a7d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:25.520059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-ba623715-bf96-45d4-afd1-10b47b7abfd4 req-3d86018b-2ffe-4eac-aa63-c980452e6a7d service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:25.718178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-ba623715-bf96-45d4-afd1-10b47b7abfd4 req-3d86018b-2ffe-4eac-aa63-c980452e6a7d service nova] Creating event network-changed:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:12:25.723391 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-ba623715-bf96-45d4-afd1-10b47b7abfd4 req-3d86018b-2ffe-4eac-aa63-c980452e6a7d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229919 Jul 26 15:12:25.724129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 477/972] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:25.959014 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:25.959857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:25.967716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:25.968294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:25.969275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:25.969520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:26.201026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:26.210756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:26.212338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:26.213530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8745ec67-c54b-448b-bb09-f9d80b2c7faa tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1598 microversion: 2.20 time: 0.260119 Jul 26 15:12:26.214171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 496/973] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:12:25 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1598 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:12:26.248580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:26.250129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:26.261433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:26.262266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:26.263183 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:26.263845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:26.372499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-76bb4818-663f-4146-9123-17eae36beda1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129514 Jul 26 15:12:26.373557 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 478/974] 10.222.0.94 () {60 vars in 1316 bytes} [Tue Jul 26 15:12:26 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:12:27.125102 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:27.127881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:27.135256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.148198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.148198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.148198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.171725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5b3fe126-e650-4687-80f4-cef8c6f22c50 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052021 Jul 26 15:12:27.174049 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 497/975] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:27 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:27.186178 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:27.186762 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:27.198474 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.199772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.203250 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.203250 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.234719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d43acbf4-1689-4655-b20f-99a94c67bce7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/5d4f5b5c-c711-4390-b940-4c00826ec2a5" status: 200 len: 194 microversion: 2.1 time: 0.054247 Jul 26 15:12:27.235326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 479/976] 10.222.0.94 () {58 vars in 1413 bytes} [Tue Jul 26 15:12:27 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/5d4f5b5c-c711-4390-b940-4c00826ec2a5 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:27.654485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:27.655568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:27.657726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:27.663752 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.664394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.665353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.665866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.745025 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-c55a4eb7-6a30-4172-9947-89bb7cf9668e req-cf919df2-3ef4-4414-ad0f-8c087904bb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:27.759003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-c55a4eb7-6a30-4172-9947-89bb7cf9668e req-cf919df2-3ef4-4414-ad0f-8c087904bb5b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:27.759806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-c55a4eb7-6a30-4172-9947-89bb7cf9668e req-cf919df2-3ef4-4414-ad0f-8c087904bb5b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:27.772713 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lazy-loading 'services' on Instance uuid 74359d93-5827-4800-a2e7-92675b4a30b3 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:27.800626 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-c55a4eb7-6a30-4172-9947-89bb7cf9668e req-cf919df2-3ef4-4414-ad0f-8c087904bb5b service nova] Creating event network-changed:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:12:27.814264 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-c55a4eb7-6a30-4172-9947-89bb7cf9668e req-cf919df2-3ef4-4414-ad0f-8c087904bb5b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077306 Jul 26 15:12:27.816212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 480/977] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:12:28.064309 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1cb3c4d6-3a55-4ea2-9919-ff051ab69289 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments/c308856e-0e10-4c27-9b65-638787dfca16" status: 202 len: 0 microversion: 2.1 time: 0.413398 Jul 26 15:12:28.066926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 498/978] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:12:27 2022] DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments/c308856e-0e10-4c27-9b65-638787dfca16 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:28.076723 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:28.079017 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:28.091062 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:28.091535 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:28.093248 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:28.093404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:28.182270 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-29ae0706-f6ab-44c5-90a3-feee7b992cb7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110273 Jul 26 15:12:28.183885 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 481/979] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:28 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:12:28.993609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e0af4c7-7756-4be6-bdf7-1cbc6c846484"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:28.997727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:29.004550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:29.005331 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:29.006109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:29.006543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:29.198651 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:29.204080 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:29.216143 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:29.222541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:29.222541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:29.222541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:29.260977 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-41753924-d57a-4274-aa6c-881754bd6220 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069008 Jul 26 15:12:29.263126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 482/980] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:29 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:29.810493 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-dab346d6-a948-44de-85c7-f52c0130316f tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "POST /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821796 Jul 26 15:12:29.811039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 499/981] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:12:28 2022] POST /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:29.831720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-cc2d020e-36c6-4fc4-a705-97e5355aa43a req-d0128983-55d1-416b-8da2-c8700efdd594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:29.842020 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-cc2d020e-36c6-4fc4-a705-97e5355aa43a req-d0128983-55d1-416b-8da2-c8700efdd594 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:29.842500 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-cc2d020e-36c6-4fc4-a705-97e5355aa43a req-d0128983-55d1-416b-8da2-c8700efdd594 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:29.854225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-cc2d020e-36c6-4fc4-a705-97e5355aa43a req-d0128983-55d1-416b-8da2-c8700efdd594 service nova] Creating event network-changed:914aac9d-0f65-4fef-a9cf-7ea754b0fa1d for instance 16ce9439-b753-41cb-a9b1-042db35be70b on hv-cinder-85066 Jul 26 15:12:29.860006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-cc2d020e-36c6-4fc4-a705-97e5355aa43a req-d0128983-55d1-416b-8da2-c8700efdd594 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Jul 26 15:12:29.860795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 483/982] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:30.276020 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:30.279194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:30.285893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:30.286341 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:30.287118 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:30.287576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:30.321069 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bf7762ae-f1b5-4c61-8481-296cf6461a92 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050385 Jul 26 15:12:30.321852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 500/983] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:30 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:12:30.333828 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:30.334413 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:30.336389 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:30.342399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:30.342853 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:30.343666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:30.344108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:30.429673 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] HTTP exception thrown: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 is not attached to volume c308856e-0e10-4c27-9b65-638787dfca16 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Request method failure captured: Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments/c308856e-0e10-4c27-9b65-638787dfca16 HTTP/1.1 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AOYciu927d1dQ4qRQ0YqrURsYp-CvjPpEYIMuVIBM7vFtm9CxfEOC0FYlqCJ0RjEXckLhJpMfMGcCCh3lqvlSrQprTM0mTWbYHhnDn1maiQDZ4j2s5rjoNEn_5hRi8anbrAY6ctU6EPL-3MxRmlhA7XXB5BKbxq9KOFrd2ree2e_rA Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: ee9262c91631413b991af2efeb169cd0 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-TestMinimumBasicScenario-31182315 Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:12:30.435757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_ee9262c91631413b991af2efeb169cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/ee9262c91631413b991af2efeb169cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ee9262c91631413b991af2efeb169cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ee9262c91631413b991af2efeb169cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-TestMinimumBasicScenario-31182315 Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: ee9262c91631413b991af2efeb169cd0 Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-TestMinimumBasicScenario-31182315 Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-TestMinimumBasicScenario-31182315-project Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 9ab7f2a0dcf64aa2ba8c891fc59bc8d2 Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-TestMinimumBasicScenario-31182315-project Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:12:30.438900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 is not attached to volume c308856e-0e10-4c27-9b65-638787dfca16 Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'server_id': '74359d93-5827-4800-a2e7-92675b4a30b3', 'id': 'c308856e-0e10-4c27-9b65-638787dfca16'} Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c308856e-0e10-4c27-9b65-638787dfca16. Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:30.439725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 is not attached to volume c308856e-0e10-4c27-9b65-638787dfca16 Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 is not attached to volume c308856e-0e10-4c27-9b65-638787dfca16 Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:30.440980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Returning 404 to user: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 is not attached to volume c308856e-0e10-4c27-9b65-638787dfca16 {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:30.443871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-eb7b1620-151e-4962-a2a5-7ca91971e6c5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments/c308856e-0e10-4c27-9b65-638787dfca16" status: 404 len: 154 microversion: 2.1 time: 0.108311 Jul 26 15:12:30.443871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 484/984] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:12:30 2022] DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3/os-volume_attachments/c308856e-0e10-4c27-9b65-638787dfca16 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:31.743636 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:31.747186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:31.752594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:31.753034 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:31.753798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:31.754223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:31.779686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:12:32.063140 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5ff267c8-7d93-4b69-9c22-99c7b3a7e1b0 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 204 len: 0 microversion: 2.1 time: 0.323303 Jul 26 15:12:32.063952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 501/985] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:12:31 2022] DELETE /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:32.072605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:32.073203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:32.080709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:32.081154 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:32.081918 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:32.082350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:32.215520 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:32.223611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-88fb1f20-0666-41da-b74c-d89425c2166d tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1555 microversion: 2.1 time: 0.155068 Jul 26 15:12:32.224086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 485/986] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:32 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:33.246135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:33.246893 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:33.253837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:33.262261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:33.262261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:33.262261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:33.395734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:33.404119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-52da7279-fc44-4b18-969d-6f5055f60b02 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1555 microversion: 2.1 time: 0.162225 Jul 26 15:12:33.404700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 502/987] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:33 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:34.425959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:34.426673 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:34.434788 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:34.435249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:34.436073 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:34.436504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:34.582592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:34.590616 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d6f751a2-d3f2-42f9-83f1-ac9d14bef86e tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1555 microversion: 2.1 time: 0.168467 Jul 26 15:12:34.591235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 486/988] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:34 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:35.549436 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-bb06e3b7-9bf7-4598-ab64-d452153d9854 req-0e932a3a-e624-4ae9-9b12-868ec7cbc98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74359d93-5827-4800-a2e7-92675b4a30b3", "name": "network-vif-deleted", "tag": "6d53b356-223b-4f5d-a62b-88f2c5b69216"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:35.561107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-bb06e3b7-9bf7-4598-ab64-d452153d9854 req-0e932a3a-e624-4ae9-9b12-868ec7cbc98f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:35.561782 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-bb06e3b7-9bf7-4598-ab64-d452153d9854 req-0e932a3a-e624-4ae9-9b12-868ec7cbc98f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:35.565701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:35.573227 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-bb06e3b7-9bf7-4598-ab64-d452153d9854 req-0e932a3a-e624-4ae9-9b12-868ec7cbc98f service nova] Creating event network-vif-deleted:6d53b356-223b-4f5d-a62b-88f2c5b69216 for instance 74359d93-5827-4800-a2e7-92675b4a30b3 on hv-cinder-85066 Jul 26 15:12:35.579166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-bb06e3b7-9bf7-4598-ab64-d452153d9854 req-0e932a3a-e624-4ae9-9b12-868ec7cbc98f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Jul 26 15:12:35.580012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 503/989] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:35.613020 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:35.613638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:35.620535 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:35.620985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:35.621754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:35.622191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:35.953179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:35.961844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a5a93aec-11e2-433f-993d-8de2a2f4b9f5 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1513 microversion: 2.1 time: 0.352850 Jul 26 15:12:35.962517 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 487/990] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:35 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:36.985319 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:36.985964 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:36.993836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:36.994292 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:36.995077 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:36.996314 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:37.029611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:37.030063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:37.030518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lazy-loading 'fault' on Instance uuid 74359d93-5827-4800-a2e7-92675b4a30b3 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:37.080858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab7f2a0dcf64aa2ba8c891fc59bc8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9262c91631413b991af2efeb169cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:37.088792 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-14eb1bea-3e1d-4539-8ab7-d2efb0e7e0aa tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 200 len: 1348 microversion: 2.1 time: 0.107944 Jul 26 15:12:37.089600 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 504/991] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:36 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:38.110421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:38.111019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] [instance: 74359d93-5827-4800-a2e7-92675b4a30b3] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:38.117915 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.118358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.119118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.119574 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.134146 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] HTTP exception thrown: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 could not be found. Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Request method failure captured: Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 HTTP/1.1 Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AOYciu927d1dQ4qRQ0YqrURsYp-CvjPpEYIMuVIBM7vFtm9CxfEOC0FYlqCJ0RjEXckLhJpMfMGcCCh3lqvlSrQprTM0mTWbYHhnDn1maiQDZ4j2s5rjoNEn_5hRi8anbrAY6ctU6EPL-3MxRmlhA7XXB5BKbxq9KOFrd2ree2e_rA Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: ee9262c91631413b991af2efeb169cd0 Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-TestMinimumBasicScenario-31182315 Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:12:38.135720 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_ee9262c91631413b991af2efeb169cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/ee9262c91631413b991af2efeb169cd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ee9262c91631413b991af2efeb169cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ee9262c91631413b991af2efeb169cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-TestMinimumBasicScenario-31182315 Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: ee9262c91631413b991af2efeb169cd0 Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-TestMinimumBasicScenario-31182315 Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-TestMinimumBasicScenario-31182315-project Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: 9ab7f2a0dcf64aa2ba8c891fc59bc8d2 Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-TestMinimumBasicScenario-31182315-project Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 could not be found. Jul 26 15:12:38.138876 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '74359d93-5827-4800-a2e7-92675b4a30b3'} Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 could not be found. Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:38.144241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 could not be found. Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 could not be found. Jul 26 15:12:38.146447 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:38.148543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Returning 404 to user: Instance 74359d93-5827-4800-a2e7-92675b4a30b3 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:38.148543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6ea7e55a-35e0-4b54-ae13-bd19fd9f46c7 tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3" status: 404 len: 111 microversion: 2.1 time: 0.031288 Jul 26 15:12:38.148543 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 488/992] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:38 2022] GET /compute/v2.1/servers/74359d93-5827-4800-a2e7-92675b4a30b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:38.148918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-55fcb20a-4b67-482c-8d5a-a48869fae0ad tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] Calling method '.version_select at 0x7f4532bf55e0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:38.236087 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-55fcb20a-4b67-482c-8d5a-a48869fae0ad tempest-TestMinimumBasicScenario-31182315 tempest-TestMinimumBasicScenario-31182315-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-817176606" status: 202 len: 0 microversion: 2.1 time: 0.092560 Jul 26 15:12:38.236671 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 505/993] 10.222.0.94 () {58 vars in 1269 bytes} [Tue Jul 26 15:12:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-817176606 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:38.422755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:38.423591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:38.429661 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.430386 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.431262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.431614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.464898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ccc1a9bf-bc43-4c96-b6d6-48a1987cc5ed tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048009 Jul 26 15:12:38.465479 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 489/994] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:38 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:38.640632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:38.641037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:38.647070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.647553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.648343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.648770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.682830 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fc299b66-f382-418a-887c-a26337fe3eae tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/5d4f5b5c-c711-4390-b940-4c00826ec2a5" status: 200 len: 194 microversion: 2.1 time: 0.046881 Jul 26 15:12:38.684274 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 506/995] 10.222.0.94 () {58 vars in 1413 bytes} [Tue Jul 26 15:12:38 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/5d4f5b5c-c711-4390-b940-4c00826ec2a5 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:38.694733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:38.695214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:38.702526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.703031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.703788 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.704218 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.794794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lazy-loading 'services' on Instance uuid a1b2bf06-311c-4236-9633-75f06c72444b {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:38.971243 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c13fc34c-a0fb-4e99-b0a6-2043e5c57054 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/5d4f5b5c-c711-4390-b940-4c00826ec2a5" status: 202 len: 0 microversion: 2.1 time: 0.280180 Jul 26 15:12:38.971850 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 490/996] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:12:38 2022] DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/5d4f5b5c-c711-4390-b940-4c00826ec2a5 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:41.176466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:41.177113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:41.183810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.184353 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.185210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.185648 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.217109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1c8d4568-097e-4606-a58e-08881af1ba68 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/1e0af4c7-7756-4be6-bdf7-1cbc6c846484" status: 200 len: 194 microversion: 2.1 time: 0.045115 Jul 26 15:12:41.217728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 507/997] 10.222.0.94 () {58 vars in 1413 bytes} [Tue Jul 26 15:12:41 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/1e0af4c7-7756-4be6-bdf7-1cbc6c846484 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:41.230893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:41.231557 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:41.240032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.240479 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.241484 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.242917 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.347440 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lazy-loading 'services' on Instance uuid a1b2bf06-311c-4236-9633-75f06c72444b {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:41.617515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f060bfa7-275c-4345-982d-af4d52f0460c tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/1e0af4c7-7756-4be6-bdf7-1cbc6c846484" status: 202 len: 0 microversion: 2.1 time: 0.392388 Jul 26 15:12:41.874967 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 491/998] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:12:41 2022] DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments/1e0af4c7-7756-4be6-bdf7-1cbc6c846484 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:43.875993 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:43.878173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:43.885010 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:43.885455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:43.886949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:43.887394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:43.919679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-737ac25d-32ee-48c4-ba50-8ef434c1b99d tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047475 Jul 26 15:12:43.920155 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 508/999] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:43 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:12:44.050726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:44.053118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:44.059553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.060002 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.060869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.061314 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.091502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b8d31c2f-3e33-4ec0-879d-452f7b167b85 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045644 Jul 26 15:12:44.092097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 492/1000] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:12:44 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:12:44.157012 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:44.157516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:44.163813 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.164142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.164915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.165426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.191570 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:12:44.589057 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8ab3d007-81c7-4712-a80d-2668f3fbe5f1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 204 len: 0 microversion: 2.1 time: 0.435587 Jul 26 15:12:44.589821 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 509/1001] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:12:44 2022] DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:44.598179 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:44.598799 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:44.609529 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.609970 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.611067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.611755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.851025 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:44.859142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b078cd5a-1b47-40e9-8813-3f480448a8e7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1674 microversion: 2.1 time: 0.264928 Jul 26 15:12:44.859766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 493/1002] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:44 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:45.884085 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:45.884902 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:45.892743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.893184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:45.894180 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.894702 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:46.218958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:46.227340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-814d0cee-9139-4cf6-a5ac-dd8640da95c4 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1674 microversion: 2.1 time: 0.348449 Jul 26 15:12:46.228094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 510/1003] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:45 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1674 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:47.254811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:47.257126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:47.264819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:47.265512 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:47.266714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:47.268413 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:47.288711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:47.436884 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:47.444929 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a3e6bfcb-0a7d-44d6-8f79-e51b55a6cedd tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1674 microversion: 2.1 time: 0.194651 Jul 26 15:12:47.445511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 494/1004] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:47 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:48.448663 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-aef2e019-8917-493b-87c7-7f6956df796d req-a6a65427-24c5-4792-abbe-2516f10e69ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b2bf06-311c-4236-9633-75f06c72444b", "name": "network-vif-deleted", "tag": "0795ddd0-1598-416b-bba7-7755c9380123"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:48.461805 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-aef2e019-8917-493b-87c7-7f6956df796d req-a6a65427-24c5-4792-abbe-2516f10e69ad service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:48.462505 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-aef2e019-8917-493b-87c7-7f6956df796d req-a6a65427-24c5-4792-abbe-2516f10e69ad service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:48.468461 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:48.469070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:48.482807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:48.483880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:48.486608 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:48.487089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-aef2e019-8917-493b-87c7-7f6956df796d req-a6a65427-24c5-4792-abbe-2516f10e69ad service nova] Creating event network-vif-deleted:0795ddd0-1598-416b-bba7-7755c9380123 for instance a1b2bf06-311c-4236-9633-75f06c72444b on hv-cinder-85066 Jul 26 15:12:48.487229 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:48.497038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-aef2e019-8917-493b-87c7-7f6956df796d req-a6a65427-24c5-4792-abbe-2516f10e69ad service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051324 Jul 26 15:12:48.499071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 511/1005] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:48.626668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:48.642997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a30aafff-248a-4820-8f49-6ec73fb84af8 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1606 microversion: 2.1 time: 0.180220 Jul 26 15:12:48.643649 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 495/1006] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:48 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1606 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:49.667866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:49.671795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:49.677837 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:49.678712 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:49.679927 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:49.680592 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:49.715813 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:49.716270 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:49.717062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lazy-loading 'fault' on Instance uuid a1b2bf06-311c-4236-9633-75f06c72444b {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:49.759945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bc5bf55e9d452b88757ea4080165e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08db5f6552054a6c97ed644366d18b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:49.768787 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-90a00043-0d7d-4e49-bdfc-789e40b28412 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 200 len: 1327 microversion: 2.1 time: 0.107471 Jul 26 15:12:49.769373 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 512/1007] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:49 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:50.790084 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:50.790691 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:50.797000 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:50.797490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:50.798258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:50.798792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:50.812109 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] HTTP exception thrown: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Request method failure captured: Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b HTTP/1.1 Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKgU0K-FjKSHO3ltSrX2WpVww3KvxMsRmDLMkknCHAxrXehaKlnfftKVHIo925_2xywbGTeAB2vpFweP_pIdEQ0L-mYK9ofWAg4bamrZjtEQETSlyDidzjYOxQH-lo2sXq1rtl1seR3S35OIBRgAun-iMpgABzO_lyMVKPEyxiIFHk Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:12:50.813756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_08db5f6552054a6c97ed644366d18b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: a1bc5bf55e9d452b88757ea4080165e0 Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:50.816219 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'a1b2bf06-311c-4236-9633-75f06c72444b'} Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:50.817227 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:50.819241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:50.820768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Returning 404 to user: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:50.820768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b6050f0a-1c67-4135-b237-51fb865d8f10 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 404 len: 111 microversion: 2.1 time: 0.028948 Jul 26 15:12:50.820768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 496/1008] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:50 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:50.828942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bbb9b2d1-e053-4784-a008-507022eed905 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '.version_select at 0x7f4532b32e50>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:50.932680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bbb9b2d1-e053-4784-a008-507022eed905 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-244325593" status: 202 len: 0 microversion: 2.1 time: 0.107796 Jul 26 15:12:50.933425 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 513/1009] 10.222.0.94 () {58 vars in 1218 bytes} [Tue Jul 26 15:12:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-244325593 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:54.602764 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:54.603354 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:54.610360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:54.614266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:54.614266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:54.614266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:54.625950 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] HTTP exception thrown: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Request method failure captured: Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b HTTP/1.1 Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKgU0K-FjKSHO3ltSrX2WpVww3KvxMsRmDLMkknCHAxrXehaKlnfftKVHIo925_2xywbGTeAB2vpFweP_pIdEQ0L-mYK9ofWAg4bamrZjtEQETSlyDidzjYOxQH-lo2sXq1rtl1seR3S35OIBRgAun-iMpgABzO_lyMVKPEyxiIFHk Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:12:54.627503 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_08db5f6552054a6c97ed644366d18b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: a1bc5bf55e9d452b88757ea4080165e0 Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.629065 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'a1b2bf06-311c-4236-9633-75f06c72444b'} Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:54.630059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.631951 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.633547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Returning 404 to user: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:54.633547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f0d94499-9845-450a-a931-1d377934f577 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 404 len: 111 microversion: 2.1 time: 0.029942 Jul 26 15:12:54.633547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 497/1010] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:12:54 2022] DELETE /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:54.639284 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:54.643654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: a1b2bf06-311c-4236-9633-75f06c72444b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:54.648906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:54.649349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:54.650116 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:54.650547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:54.664909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] HTTP exception thrown: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Request method failure captured: Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b HTTP/1.1 Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKgU0K-FjKSHO3ltSrX2WpVww3KvxMsRmDLMkknCHAxrXehaKlnfftKVHIo925_2xywbGTeAB2vpFweP_pIdEQ0L-mYK9ofWAg4bamrZjtEQETSlyDidzjYOxQH-lo2sXq1rtl1seR3S35OIBRgAun-iMpgABzO_lyMVKPEyxiIFHk Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:12:54.666598 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_08db5f6552054a6c97ed644366d18b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: a1bc5bf55e9d452b88757ea4080165e0 Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.668242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'a1b2bf06-311c-4236-9633-75f06c72444b'} Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:54.669126 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. Jul 26 15:12:54.670481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:54.671553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Returning 404 to user: Instance a1b2bf06-311c-4236-9633-75f06c72444b could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:54.671553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ae5dd32a-2c3d-45ed-a261-bab72b5632a7 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b" status: 404 len: 111 microversion: 2.1 time: 0.034749 Jul 26 15:12:54.671553 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 514/1011] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:54 2022] GET /compute/v2.1/servers/a1b2bf06-311c-4236-9633-75f06c72444b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:55.232829 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:55.233263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:55.239938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:55.240382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:55.241187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:55.241713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:55.273747 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-72403e94-56fc-4299-9705-f85f004633f4 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/ips" status: 200 len: 150 microversion: 2.1 time: 0.045803 Jul 26 15:12:55.275645 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 498/1012] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:12:55 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:56.064715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:56.065237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:56.072029 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:56.072477 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:56.073432 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:56.074093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:56.088430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] HTTP exception thrown: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Request method failure captured: Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd HTTP/1.1 Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKgU0K-FjKSHO3ltSrX2WpVww3KvxMsRmDLMkknCHAxrXehaKlnfftKVHIo925_2xywbGTeAB2vpFweP_pIdEQ0L-mYK9ofWAg4bamrZjtEQETSlyDidzjYOxQH-lo2sXq1rtl1seR3S35OIBRgAun-iMpgABzO_lyMVKPEyxiIFHk Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:12:56.090257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_08db5f6552054a6c97ed644366d18b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: a1bc5bf55e9d452b88757ea4080165e0 Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.091926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '6d42296f-f3c6-4b95-999e-7b15b6537bfd'} Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:56.092804 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.094247 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.095799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Returning 404 to user: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:56.095799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-94001cbc-9eab-4446-b0ed-17b02432c6fc tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 404 len: 111 microversion: 2.1 time: 0.030902 Jul 26 15:12:56.095799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 515/1013] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:12:56 2022] DELETE /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:56.100879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:56.101497 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] [instance: 6d42296f-f3c6-4b95-999e-7b15b6537bfd] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:56.109228 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:56.109685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:56.110907 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:56.111308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:56.127079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] HTTP exception thrown: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Request method failure captured: Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd HTTP/1.1 Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKgU0K-FjKSHO3ltSrX2WpVww3KvxMsRmDLMkknCHAxrXehaKlnfftKVHIo925_2xywbGTeAB2vpFweP_pIdEQ0L-mYK9ofWAg4bamrZjtEQETSlyDidzjYOxQH-lo2sXq1rtl1seR3S35OIBRgAun-iMpgABzO_lyMVKPEyxiIFHk Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:12:56.128879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_08db5f6552054a6c97ed644366d18b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/08db5f6552054a6c97ed644366d18b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 08db5f6552054a6c97ed644366d18b22 Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1012248622 Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: a1bc5bf55e9d452b88757ea4080165e0 Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeTestJSON-1012248622-project Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.130472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '6d42296f-f3c6-4b95-999e-7b15b6537bfd'} Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:56.131522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. Jul 26 15:12:56.133036 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:12:56.134444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] Returning 404 to user: Instance 6d42296f-f3c6-4b95-999e-7b15b6537bfd could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:56.134444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-931cb4cf-9f86-495a-91d5-0d89ff267aa1 tempest-AttachVolumeTestJSON-1012248622 tempest-AttachVolumeTestJSON-1012248622-project] 10.222.0.94 "GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd" status: 404 len: 111 microversion: 2.1 time: 0.033421 Jul 26 15:12:56.134444 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 499/1014] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:56 2022] GET /compute/v2.1/servers/6d42296f-f3c6-4b95-999e-7b15b6537bfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:57.024550 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef90feb2-56f9-469c-bced-e642a8457a85"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:57.027131 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:57.033240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:57.033695 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:57.034478 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:57.034916 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:57.964657 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7f189c4b-fab2-4b8d-b400-aa3d6b98e87e tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "POST /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943024 Jul 26 15:12:57.965887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 516/1015] 10.222.0.94 () {60 vars in 1323 bytes} [Tue Jul 26 15:12:57 2022] POST /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:05.663170 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:05.671322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:05.671322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=32 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:05.672920 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:05.672920 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:05.673361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:05.673751 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:05.770289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'services' on Instance uuid e6afb844-0c21-40c3-a0d6-a30adfc2ed23 {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:13:06.121037 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-998522d4-7c53-43e3-96aa-c29e71b4f49b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments/ef90feb2-56f9-469c-bced-e642a8457a85" status: 202 len: 0 microversion: 2.1 time: 0.461581 Jul 26 15:13:06.126028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 500/1016] 10.222.0.94 () {58 vars in 1416 bytes} [Tue Jul 26 15:13:05 2022] DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments/ef90feb2-56f9-469c-bced-e642a8457a85 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:06.131706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:06.134844 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:06.137246 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:06.142967 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:06.143413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:06.145020 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:06.146038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:06.179918 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-bf1392b3-0106-49a9-aeec-ee6398f67bd6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053363 Jul 26 15:13:06.180490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 517/1017] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:06 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:07.194452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:07.196978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:07.204486 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:07.204943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:07.205734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:07.206186 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:07.238795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a5241a78-80aa-4c42-8be0-ff3907a19888 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049541 Jul 26 15:13:07.239385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 501/1018] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:07 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:08.250782 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:08.253199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:08.261051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:08.265513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:08.265513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:08.265513 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:08.265957 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:08.298364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-203c62d5-3215-4ef4-8a6e-26005d79e807 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051609 Jul 26 15:13:08.299192 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 518/1019] 10.222.0.94 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:08 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:13:08.370061 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:08.370660 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:08.378193 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:08.379022 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:08.379717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:08.380443 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:08.409042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:13:08.782685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7e1e1951-5965-4f03-8a82-4b8096082e1b tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 204 len: 0 microversion: 2.1 time: 0.416846 Jul 26 15:13:08.783275 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 502/1020] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:08 2022] DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:13:08.791665 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:08.792315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:08.799819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:08.800271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:08.801049 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:08.801483 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:08.937242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:08.944891 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a9550905-95e0-48be-ba5c-3977c0b0d6d6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1683 microversion: 2.1 time: 0.157193 Jul 26 15:13:08.945466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 519/1021] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:08 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:09.967097 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:09.967831 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:09.974592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:09.975024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:09.975831 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:09.976271 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:10.119931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:10.127938 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a7fc5d23-818f-4bad-bb60-34ed3fd30383 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1683 microversion: 2.1 time: 0.165238 Jul 26 15:13:10.128559 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 503/1022] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:09 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:11.151582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:11.152920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:11.162754 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:11.163838 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:11.164261 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:11.165062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:11.333276 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:11.348819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cbbb75f6-6e61-4941-b1f2-902b1adcff51 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1683 microversion: 2.1 time: 0.202614 Jul 26 15:13:11.350305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 520/1023] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:11 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:11.965350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-af5181e0-4e01-4046-b6ac-867997f4afbf req-b910cede-50b2-4730-8fe8-111b6d1fa080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6afb844-0c21-40c3-a0d6-a30adfc2ed23", "name": "network-vif-deleted", "tag": "d26cb2f7-8f51-4b59-948e-25c442c7dd79"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:11.975714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-af5181e0-4e01-4046-b6ac-867997f4afbf req-b910cede-50b2-4730-8fe8-111b6d1fa080 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:11.976169 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-af5181e0-4e01-4046-b6ac-867997f4afbf req-b910cede-50b2-4730-8fe8-111b6d1fa080 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:11.989744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-af5181e0-4e01-4046-b6ac-867997f4afbf req-b910cede-50b2-4730-8fe8-111b6d1fa080 service nova] Creating event network-vif-deleted:d26cb2f7-8f51-4b59-948e-25c442c7dd79 for instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 on hv-cinder-85066 Jul 26 15:13:11.995316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-af5181e0-4e01-4046-b6ac-867997f4afbf req-b910cede-50b2-4730-8fe8-111b6d1fa080 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 Jul 26 15:13:11.996001 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 504/1024] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:12.375043 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:12.376392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:12.394972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:12.397328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:12.398942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:12.401318 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:12.439581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:12.440122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:12.440649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lazy-loading 'fault' on Instance uuid e6afb844-0c21-40c3-a0d6-a30adfc2ed23 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:13:12.495769 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2738e8ef94a48bb9a0d6b1177598112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242289f1dedc45ccbdd6aa8e19d4e414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:12.504182 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-583ce85b-7585-4d35-87a3-61e2b1396dad tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 200 len: 1332 microversion: 2.1 time: 0.133950 Jul 26 15:13:12.504777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 521/1025] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:12 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:13.528904 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:13.529592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:13.536029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:13.536468 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:13.537232 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:13.537662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:13.552458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 HTTP/1.1 Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:13:13.554279 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:13.555880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'e6afb844-0c21-40c3-a0d6-a30adfc2ed23'} Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:13.557291 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:13.559290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:13.560845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:13.560845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3a8b67f0-c5db-4654-8ba7-10d284fb7ae5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 404 len: 111 microversion: 2.1 time: 0.031516 Jul 26 15:13:13.560845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 505/1026] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:13 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:13.567044 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-99df7ca5-ecd1-49d3-96d7-abcf59691a03 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '.version_select at 0x7f4532b459d0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:13.658101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-99df7ca5-ecd1-49d3-96d7-abcf59691a03 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230912853" status: 202 len: 0 microversion: 2.1 time: 0.095511 Jul 26 15:13:13.658688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 522/1027] 10.222.0.94 () {58 vars in 1221 bytes} [Tue Jul 26 15:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230912853 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:15.069504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:15.070070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:15.077523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:15.077523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:15.078197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:15.078635 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:15.105978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-82483695-5e39-4a7e-a693-a61984e0091b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/ips" status: 200 len: 152 microversion: 2.20 time: 0.040704 Jul 26 15:13:15.106562 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 506/1028] 10.222.0.94 () {60 vars in 1289 bytes} [Tue Jul 26 15:13:15 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:13:16.079725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:16.080428 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:16.099237 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:16.100073 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:16.101134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:16.101986 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:16.121647 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 HTTP/1.1 Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:16.124874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.127862 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'e6afb844-0c21-40c3-a0d6-a30adfc2ed23'} Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:16.129591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.132238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.139962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:16.139962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2077d732-fd30-43cb-908b-5dcbce926199 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 404 len: 111 microversion: 2.1 time: 0.051864 Jul 26 15:13:16.139962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 523/1029] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:16 2022] DELETE /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:16.146035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:16.147814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: e6afb844-0c21-40c3-a0d6-a30adfc2ed23] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:16.162404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:16.163138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:16.167141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:16.167141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:16.186936 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 HTTP/1.1 Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:13:16.196011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.198028 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'e6afb844-0c21-40c3-a0d6-a30adfc2ed23'} Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:16.199252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. Jul 26 15:13:16.200654 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:16.201979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance e6afb844-0c21-40c3-a0d6-a30adfc2ed23 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:16.201979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8685074f-b8ee-46a6-bdfe-8eefec1f4e76 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23" status: 404 len: 111 microversion: 2.1 time: 0.052723 Jul 26 15:13:16.201979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 507/1030] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:16 2022] GET /compute/v2.1/servers/e6afb844-0c21-40c3-a0d6-a30adfc2ed23 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:17.610863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:17.611976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:17.620610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.621062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.621866 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.622295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.629591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:17.631632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:17.639646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 HTTP/1.1 Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:17.641299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.642798 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'a02cbd58-fa78-47f5-ac51-4e1aa930e4f7'} Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:17.644147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.645858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.647197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:17.647197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c6a99f34-666b-4dd2-ae40-d2e901f5ebd5 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 404 len: 111 microversion: 2.1 time: 0.035869 Jul 26 15:13:17.647197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 524/1031] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:17 2022] DELETE /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:17.649213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.650115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.651686 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.652549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.654870 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:17.656138 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: a02cbd58-fa78-47f5-ac51-4e1aa930e4f7] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:17.662401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.662956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.663800 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.664307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.680465 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 HTTP/1.1 Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:17.684071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.694878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'a02cbd58-fa78-47f5-ac51-4e1aa930e4f7'} Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:17.696472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. Jul 26 15:13:17.699687 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.700939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:17.700939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cf6799fe-3610-4ff3-a166-b4980cbe2f43 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7" status: 404 len: 111 microversion: 2.1 time: 0.035855 Jul 26 15:13:17.700939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 525/1032] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:17 2022] GET /compute/v2.1/servers/a02cbd58-fa78-47f5-ac51-4e1aa930e4f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:17.700939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:17.700939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:17.703914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.704366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.705132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.705565 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.707204 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lazy-loading 'flavor' on Instance uuid 16ce9439-b753-41cb-a9b1-042db35be70b {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:13:17.723096 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: DELETE /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 HTTP/1.1 Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:17.724703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.726279 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '22db4394-5de8-471c-8738-b0484e5f7032'} Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:17.727265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.728930 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.730556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:17.730556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a190d87c-edc6-41e6-b113-4ba345f4a120 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 404 len: 111 microversion: 2.1 time: 0.034758 Jul 26 15:13:17.730556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 526/1033] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:17 2022] DELETE /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:13:17.735638 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:17.736256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 22db4394-5de8-471c-8738-b0484e5f7032] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:17.742906 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.743412 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.745887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:17.746229 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:17.766710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 HTTP/1.1 Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:17.774332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.776054 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '22db4394-5de8-471c-8738-b0484e5f7032'} Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:17.776944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. Jul 26 15:13:17.778409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:17.779595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance 22db4394-5de8-471c-8738-b0484e5f7032 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:17.779595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-66ce4a3f-753e-4057-879b-ba35ca64bf20 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032" status: 404 len: 111 microversion: 2.1 time: 0.038711 Jul 26 15:13:17.779595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 527/1034] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:17 2022] GET /compute/v2.1/servers/22db4394-5de8-471c-8738-b0484e5f7032 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:13:18.359445 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9e31941b-3d64-4171-95cb-a719cd32416c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/action" status: 202 len: 0 microversion: 2.20 time: 0.738138 Jul 26 15:13:18.360599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 508/1035] 10.222.0.94 () {62 vars in 1319 bytes} [Tue Jul 26 15:13:17 2022] POST /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:13:18.374701 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:18.375989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:18.387755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:18.388242 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:18.389643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:18.390421 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:18.564681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:18.574925 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:18.576589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:18.577824 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4ba8c629-6406-4efc-b482-24c3b5c7d634 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.211621 Jul 26 15:13:18.578392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 528/1036] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:18 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:19.198680 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:19.199289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:19.205819 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.206264 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.207051 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.207514 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.210567 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:19.223360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf HTTP/1.1 Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:13:19.225148 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.226818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '2e94e2c3-8b57-4a91-831d-7afb4e64dcaf'} Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:19.227924 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.229726 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.231533 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:19.231533 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2a74aea4-1485-447f-adb7-e277be5e2bb6 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 404 len: 111 microversion: 2.1 time: 0.034393 Jul 26 15:13:19.231533 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 509/1037] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:19 2022] DELETE /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:19.237015 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:19.237735 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] [instance: 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:19.248551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.248551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.248551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.248551 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.263892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] HTTP exception thrown: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Request method failure captured: Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf HTTP/1.1 Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4AKYiNXYkloeYvzfMib6xnBN4XytQO8hfXMIdXU-rS2ABoHPW0esrfx6GKF9sU5iF4CKW5iR32B7e1LCAdttT5cPi4HkFn7OwngUQ_COfZO5gN1Bdts3pBJmlVuS_0qmWqp8V6BMvgQbg_YTyaqrlBloP6q9X6rFq_rlrvrZTG4qUBw Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:19.265312 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/242289f1dedc45ccbdd6aa8e19d4e414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 242289f1dedc45ccbdd6aa8e19d4e414 Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2049841010 Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: d2738e8ef94a48bb9a0d6b1177598112 Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeNegativeTest-2049841010-project Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.266835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '2e94e2c3-8b57-4a91-831d-7afb4e64dcaf'} Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:19.271334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. Jul 26 15:13:19.272796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:19.274629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] Returning 404 to user: Instance 2e94e2c3-8b57-4a91-831d-7afb4e64dcaf could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:19.274629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3e237f99-83e8-46b3-9b84-098aed264b55 tempest-AttachVolumeNegativeTest-2049841010 tempest-AttachVolumeNegativeTest-2049841010-project] 10.222.0.94 "GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf" status: 404 len: 111 microversion: 2.1 time: 0.034136 Jul 26 15:13:19.274629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 529/1038] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:19 2022] GET /compute/v2.1/servers/2e94e2c3-8b57-4a91-831d-7afb4e64dcaf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:19.604431 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:19.605251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:19.612305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.612835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.613738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.614228 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.760893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:19.770091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:19.771855 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:19.773066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ee01ed64-5abf-48c5-9aa6-25498f6cdf37 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.173955 Jul 26 15:13:19.773667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 510/1039] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:19 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:20.802658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:20.804023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:20.813342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:20.813342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:20.813342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:20.813342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:21.014429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:21.023605 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:21.025693 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:21.027121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c35caba8-85b1-4b22-bbdc-012eb8e1bcc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.233213 Jul 26 15:13:21.028243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 530/1040] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:20 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:22.053919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:22.055285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:22.071424 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:22.078511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:22.078511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:22.078511 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:22.258150 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:22.270999 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:22.273004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:22.275398 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cadef94f-fc1e-4ed4-af98-dd81c8866b80 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.227691 Jul 26 15:13:22.276824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 511/1041] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:22 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:23.299974 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:23.300764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:23.308545 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:23.309265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:23.310250 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:23.310969 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:23.498745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:23.518106 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:23.520099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:23.521493 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6823d3bf-df25-4382-bb66-20aa03658142 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.225456 Jul 26 15:13:23.522050 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 531/1042] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:23 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:24.545191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:24.545771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:24.556573 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:24.557091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:24.557925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:24.558425 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:24.715977 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:24.723963 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:24.725502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:24.726680 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f269bf3b-cdbb-49ea-ba70-01f59b277097 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.185527 Jul 26 15:13:24.727524 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 512/1043] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:24 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:25.749639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:25.750232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:25.756455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:25.756912 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:25.759851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:25.759851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:25.903772 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:25.912463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:25.914540 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:25.918868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d2978008-6985-4ec8-8521-6c574ecee1ac tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.170094 Jul 26 15:13:25.918868 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 532/1044] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:25 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:26.163832 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1cc4a3e5-957c-4464-8358-9db7876eaba7 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Action: 'create', calling method: .version_select at 0x7f4536b158b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-845537506", "metadata": {"Type": "work"}}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:26.846856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1cc4a3e5-957c-4464-8358-9db7876eaba7 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.837526 Jul 26 15:13:26.847526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 513/1045] 10.222.0.94 () {60 vars in 1156 bytes} [Tue Jul 26 15:13:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 839 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 26 15:13:26.860944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-55504cc0-dda7-4cfc-a17a-caece74bc836 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Calling method '.version_select at 0x7f4532992af0>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:26.914528 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-55504cc0-dda7-4cfc-a17a-caece74bc836 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf" status: 200 len: 352 microversion: 2.1 time: 0.057499 Jul 26 15:13:26.921685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 533/1046] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:13:26 2022] GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:26.940236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:26.941512 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:26.950339 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:26.952526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:26.958908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:26.958908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:27.119489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:27.130249 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:27.131877 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:27.133059 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-40dbeb9e-03e8-412f-bea3-6f4f8e4f17d2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.197993 Jul 26 15:13:27.133821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 514/1047] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:26 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:27.929722 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5de48934-f695-4110-b772-e58ca0c83c8f tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Calling method '.version_select at 0x7f45329dd940>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:27.978614 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5de48934-f695-4110-b772-e58ca0c83c8f tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf" status: 200 len: 353 microversion: 2.1 time: 0.052869 Jul 26 15:13:27.979185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 534/1048] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:13:27 2022] GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:27.992192 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-79653a24-6367-4f6d-a396-780e40aa95fe tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Calling method '.version_select at 0x7f45369388b0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:28.047808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-79653a24-6367-4f6d-a396-780e40aa95fe tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf" status: 200 len: 353 microversion: 2.1 time: 0.059135 Jul 26 15:13:28.048513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 515/1049] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:13:27 2022] GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:28.067153 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-575296ed-3360-4ba7-9b7c-85105d3557f0 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Calling method '.version_select at 0x7f4532841c10>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:28.157586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:28.157940 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:28.166224 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:28.166854 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:28.167891 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:28.168452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:28.326058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-575296ed-3360-4ba7-9b7c-85105d3557f0 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf" status: 202 len: 0 microversion: 2.1 time: 0.263263 Jul 26 15:13:28.326915 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 535/1050] 10.222.0.94 () {58 vars in 1248 bytes} [Tue Jul 26 15:13:28 2022] DELETE /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:28.334830 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fb5e530e-fe0a-4633-8ffc-36f5237c7661 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Calling method '.version_select at 0x7f45329dd940>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:28.350815 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:28.363261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:28.365368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:28.367404 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7d612a47-10a3-48ea-b749-cb7b60441074 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.213526 Jul 26 15:13:28.368769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 516/1051] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:28 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:28.408380 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fb5e530e-fe0a-4633-8ffc-36f5237c7661 tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf" status: 200 len: 352 microversion: 2.1 time: 0.077465 Jul 26 15:13:28.409352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 536/1052] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:13:28 2022] GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:13:29.390594 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:29.391325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:29.397932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:29.398395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:29.399156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:29.399715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:29.424052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a12cc262-56bf-4c77-81e6-8a57f1d1d5dd tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Calling method '.version_select at 0x7f4532bf5790>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:29.471770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-a12cc262-56bf-4c77-81e6-8a57f1d1d5dd tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] HTTP exception thrown: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a12cc262-56bf-4c77-81e6-8a57f1d1d5dd tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Request method failure captured: Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf HTTP/1.1 Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ASVEaY8qQ9HYRxRet2QbKrrZm8Oz9k0JMofC_pal-VVnTGGa7rDEC_vro-e8l8PIx2TfG_-Ny-YyfHGbcDw6EAjy1fp_Ej5uugQP7pBRak5xeM9DESisawqZs2MnX1YOu2d6O7somBLF-bsVYJtYix590M6_HGUiR3xNPIxuwmK8mE Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: 33ae25a451b84fc0bc93ee94b87e098e Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-VolumesGetTestJSON-1394123555 Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:29.475880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_33ae25a451b84fc0bc93ee94b87e098e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/33ae25a451b84fc0bc93ee94b87e098e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/33ae25a451b84fc0bc93ee94b87e098e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/33ae25a451b84fc0bc93ee94b87e098e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-VolumesGetTestJSON-1394123555 Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: 33ae25a451b84fc0bc93ee94b87e098e Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-VolumesGetTestJSON-1394123555 Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-VolumesGetTestJSON-1394123555-project Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 0327648e6ad549f5b4aa8b5839e3f9af Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-VolumesGetTestJSON-1394123555-project Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '9ece32b0-496b-41d9-9947-db7a4742feaf'} Jul 26 15:13:29.477593 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. (HTTP 404) (Request-ID: req-74e38af3-6a93-45cd-92d8-76962cf1a7e7) Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:29.479213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:13:29.480524 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:13:29.481979 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a12cc262-56bf-4c77-81e6-8a57f1d1d5dd tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] Returning 404 to user: Volume 9ece32b0-496b-41d9-9947-db7a4742feaf could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:29.483366 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a12cc262-56bf-4c77-81e6-8a57f1d1d5dd tempest-VolumesGetTestJSON-1394123555 tempest-VolumesGetTestJSON-1394123555-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf" status: 404 len: 109 microversion: 2.1 time: 0.060076 Jul 26 15:13:29.485076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 537/1053] 10.222.0.94 () {58 vars in 1245 bytes} [Tue Jul 26 15:13:29 2022] GET /compute/v2.1/os-volumes/9ece32b0-496b-41d9-9947-db7a4742feaf => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:13:29.579290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:29.589047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:29.590674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:29.591758 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-def70992-7a62-435c-8a9b-a38e7388549b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1744 microversion: 2.20 time: 0.205236 Jul 26 15:13:29.602156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 517/1054] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:29 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:30.617325 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:30.617935 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:30.624036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:30.624481 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:30.625482 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:30.625724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:30.841125 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:30.849432 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:30.850931 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:30.852124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-68bc4b32-f09b-4b0e-ae59-1b57cfb08f66 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1744 microversion: 2.20 time: 0.239954 Jul 26 15:13:30.852674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 538/1055] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:30 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1744 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:31.876472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:31.877096 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:31.883671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:31.884966 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:31.885489 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:31.885923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:32.036099 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:32.046163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:32.048677 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:32.073335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a01c6b14-e0f3-4e7f-abc0-d27a11bcd094 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.197940 Jul 26 15:13:32.074349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 518/1056] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:31 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:33.099796 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:33.103429 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:33.125453 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:33.127512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:33.128464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:33.128998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:33.357688 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-92faf272-6994-434a-a850-c1e2b13e4178 req-fe998efa-514c-41bf-be0c-227cd7404179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "name": "network-vif-plugged", "status": "completed", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:33.399849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-92faf272-6994-434a-a850-c1e2b13e4178 req-fe998efa-514c-41bf-be0c-227cd7404179 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:33.401441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-92faf272-6994-434a-a850-c1e2b13e4178 req-fe998efa-514c-41bf-be0c-227cd7404179 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:33.426123 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-92faf272-6994-434a-a850-c1e2b13e4178 req-fe998efa-514c-41bf-be0c-227cd7404179 service nova] Creating event network-vif-plugged:914aac9d-0f65-4fef-a9cf-7ea754b0fa1d for instance 16ce9439-b753-41cb-a9b1-042db35be70b on hv-cinder-85066 Jul 26 15:13:33.434334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-92faf272-6994-434a-a850-c1e2b13e4178 req-fe998efa-514c-41bf-be0c-227cd7404179 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082528 Jul 26 15:13:33.445401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 519/1057] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:33.473644 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:33.486943 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:33.492122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:33.494186 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1cb912ca-f792-44af-9071-bee1446b9ee0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.399682 Jul 26 15:13:33.497653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 539/1058] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:33 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:34.526376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:34.527874 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:34.536345 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:34.537860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:34.538973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:34.539842 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:34.809599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:34.824498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:34.826773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:34.828033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-45f06cae-f39f-4f3b-b0c0-4e1e8cb429a5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.308485 Jul 26 15:13:34.845061 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 520/1059] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:34 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:35.854289 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:35.855512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:35.869296 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:35.870042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:35.871384 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:35.872364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:36.024046 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:36.034005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:36.035542 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:36.036995 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1820b9dd-cba2-453e-9185-8eedab504b49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.188185 Jul 26 15:13:36.037541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 540/1060] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:35 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:13:37.066079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:37.066952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:37.071681 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:37.080203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:37.081461 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:37.082741 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:37.083483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:37.262943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:37.281382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:37.284294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:37.285908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2fb2ce10-d53f-49ac-bd45-b5babf7716e1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.227123 Jul 26 15:13:37.286900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 521/1061] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:37 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:38.330108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:38.332499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:38.343629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:38.344368 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:38.345326 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:38.345924 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:38.615093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:38.639338 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:38.643351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:38.645035 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-23f34562-2132-41bc-8e05-f98bdfc31397 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.320204 Jul 26 15:13:38.645898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 541/1062] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:38 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:13:39.676933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:39.677524 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:39.685116 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:39.685566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:39.686350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:39.686834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:39.866372 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:39.875188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:39.876755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:39.877928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a35b95a1-1e64-4681-a0f5-e0a48e863879 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.205095 Jul 26 15:13:39.878468 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 522/1063] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:39 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:40.902494 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:40.903112 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:40.910335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:40.911094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:40.911910 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:40.912506 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:41.069395 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:41.082311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:41.084241 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:41.085460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d37cba04-1858-4225-9afe-57ccbf38d438 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.187583 Jul 26 15:13:41.086022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 542/1064] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:40 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:42.110390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:42.110997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:42.118523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:42.119437 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:42.120414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:42.120856 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:42.290332 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:42.301882 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:42.303780 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:42.305700 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4168754c-ae24-4247-9a0c-39801ad328e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.199536 Jul 26 15:13:42.306871 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 523/1065] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:42 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:43.339829 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:43.345469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:43.348961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:43.414108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:43.415165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:43.417512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:43.417965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:43.439626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=92 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:43.623408 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:43.638983 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:43.643167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:43.652324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6f9e513c-c9e4-447d-ae7e-5085def94c9e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.316957 Jul 26 15:13:43.668572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 543/1066] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:43 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:44.678123 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:44.678729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:44.685451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:44.685897 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:44.686658 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:44.690265 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:44.826979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:44.835039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:44.837299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:44.841672 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7c3ccbff-04b9-4c56-9558-c75c2a605fa6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1739 microversion: 2.20 time: 0.164718 Jul 26 15:13:44.841672 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 524/1067] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:44 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:45.862394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:45.863081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:45.870361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:45.870858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:45.886459 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:45.886459 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:46.008966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:46.017597 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:46.019140 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:46.020335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c7da687d-29c3-4972-bc60-b2d6154d87c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1721 microversion: 2.20 time: 0.163318 Jul 26 15:13:46.020898 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 544/1068] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:45 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:47.044551 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:47.049331 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:47.051847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:47.052289 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:47.053100 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:47.053531 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:47.198778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:47.206985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:47.208653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:47.209825 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8c9da9f2-f457-4a19-9bbd-9fea7da50adc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1721 microversion: 2.20 time: 0.169195 Jul 26 15:13:47.210388 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 525/1069] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:47 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:48.234490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:48.235122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:48.242123 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:48.242697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:48.243669 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:48.244105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:48.422209 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:48.431438 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:48.432939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:48.434151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-564fd8e7-cf86-492e-9b31-504cff8f23b2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1724 microversion: 2.20 time: 0.203645 Jul 26 15:13:48.434696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 545/1070] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:48 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:48.458047 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2db28cf6-043b-48d9-8f03-405ae56d15cc"}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:48.460710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:48.467173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:48.467782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:48.468540 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:48.468970 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:49.142171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-21ffa42f-2d08-47c9-b9fb-89b5a326ed86 req-f993af8c-afbd-4570-b2f0-5ad61eb754cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "name": "network-vif-unplugged", "status": "completed", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:49.152540 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-21ffa42f-2d08-47c9-b9fb-89b5a326ed86 req-f993af8c-afbd-4570-b2f0-5ad61eb754cc service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:49.155313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-21ffa42f-2d08-47c9-b9fb-89b5a326ed86 req-f993af8c-afbd-4570-b2f0-5ad61eb754cc service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:49.164220 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.compute.server_external_events [req-21ffa42f-2d08-47c9-b9fb-89b5a326ed86 req-f993af8c-afbd-4570-b2f0-5ad61eb754cc service nova] Unable to find a host for instance 16ce9439-b753-41cb-a9b1-042db35be70b. Dropping event network-vif-unplugged {{(pid=130762) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 15:13:49.165318 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-21ffa42f-2d08-47c9-b9fb-89b5a326ed86 req-f993af8c-afbd-4570-b2f0-5ad61eb754cc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027558 Jul 26 15:13:49.165966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 546/1071] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 15:13:49.900842 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:49.998809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-50451b8a-5642-4a83-9192-503ca3b754e8 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.544618 Jul 26 15:13:50.000602 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 526/1072] 10.222.0.94 () {62 vars in 1364 bytes} [Tue Jul 26 15:13:48 2022] POST /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments => generated 188 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:13:50.138823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:50.143135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:50.146245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:50.146695 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:50.147521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:50.147968 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:50.418413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-877b8711-22fe-49f9-8df1-4239f8c303bb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/action" status: 202 len: 0 microversion: 2.20 time: 0.283667 Jul 26 15:13:50.422278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 547/1073] 10.222.0.94 () {62 vars in 1319 bytes} [Tue Jul 26 15:13:50 2022] POST /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:13:50.428135 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:50.429029 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:50.437240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:50.442394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:50.442394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:50.442394 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:50.957625 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:50.973269 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:50.975244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:50.976498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9b3415ff-05ac-4a3f-85fc-bd07841ca68f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1750 microversion: 2.20 time: 0.552678 Jul 26 15:13:50.977071 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 527/1074] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:50 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1750 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:13:51.816882 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:51.817457 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:51.828185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:51.828613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:51.830019 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:51.830512 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:51.831403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-105b5e5b-cbb3-4f79-aaba-8cdb087fac1b req-30ce23b5-e8bd-4bc6-aee2-235db51d4c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:51.875536 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:13:51.891619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-105b5e5b-cbb3-4f79-aaba-8cdb087fac1b req-30ce23b5-e8bd-4bc6-aee2-235db51d4c3b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:51.892088 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-105b5e5b-cbb3-4f79-aaba-8cdb087fac1b req-30ce23b5-e8bd-4bc6-aee2-235db51d4c3b service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:51.932934 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-105b5e5b-cbb3-4f79-aaba-8cdb087fac1b req-30ce23b5-e8bd-4bc6-aee2-235db51d4c3b service nova] Creating event network-changed:79dc17dd-0f41-4a9f-9307-9de726b3d06e for instance 440d23f7-96c6-46ce-b2ff-147c4070509b on hv-cinder-85066 Jul 26 15:13:51.966515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-105b5e5b-cbb3-4f79-aaba-8cdb087fac1b req-30ce23b5-e8bd-4bc6-aee2-235db51d4c3b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148565 Jul 26 15:13:51.971933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 528/1075] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:52.001931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:52.003038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:52.011167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.012634 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.013786 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.015605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.289956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:52.315782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:52.326906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:52.328371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c4e0ae7e-3fc0-4f9b-9a48-97f0b40076c7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1750 microversion: 2.20 time: 0.332629 Jul 26 15:13:52.344104 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 529/1076] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:51 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1750 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:13:52.370934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-38b8d945-9937-4719-a1d6-958a25568865 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "DELETE /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 204 len: 0 microversion: 2.1 time: 0.559240 Jul 26 15:13:52.371730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 548/1077] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:51 2022] DELETE /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:13:52.380381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:52.380998 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:52.387563 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.388049 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.388826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.389278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.633537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:52.636502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-61f6ddb5-2444-4694-95d2-a1afe8e857ab tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.260364 Jul 26 15:13:52.637158 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 530/1078] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:52 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:53.358372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:53.359052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:53.365860 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:53.366305 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:53.367069 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:53.367530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:53.516081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:53.526836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:53.528811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:53.532330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-17550605-120b-4102-b67a-3ec9d4d09e31 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1752 microversion: 2.20 time: 0.176108 Jul 26 15:13:53.532330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 549/1079] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:53 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:53.658534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:53.659216 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:53.666993 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:53.667446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:53.668240 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:53.668671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:53.857572 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:53.865546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-81bdc1ec-35e7-4cf2-a9ae-caf872764a95 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1568 microversion: 2.1 time: 0.211109 Jul 26 15:13:53.866140 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 531/1080] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:53 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:54.556917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:54.557625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:54.565198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:54.565632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:54.566984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:54.567417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:54.753472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:54.762939 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:54.764571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:54.767490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2fe79d0a-1b2d-4d4a-9614-1600dc40755f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1752 microversion: 2.20 time: 0.213552 Jul 26 15:13:54.767490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 550/1081] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:54 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:54.886760 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:54.887382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:54.894250 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:54.894700 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:54.895502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:54.896132 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:55.039906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:55.056133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0770fd26-7c1f-46f6-875e-618bc793f7d9 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1382 microversion: 2.1 time: 0.173104 Jul 26 15:13:55.057012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 532/1082] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:54 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1382 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:55.092871 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-f76af780-555b-49c2-b63b-b92e1ea58711 req-50dc958b-ad44-43a7-901a-bcdd87b08488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440d23f7-96c6-46ce-b2ff-147c4070509b", "name": "network-vif-deleted", "tag": "79dc17dd-0f41-4a9f-9307-9de726b3d06e"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:55.104977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-f76af780-555b-49c2-b63b-b92e1ea58711 req-50dc958b-ad44-43a7-901a-bcdd87b08488 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.105671 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-f76af780-555b-49c2-b63b-b92e1ea58711 req-50dc958b-ad44-43a7-901a-bcdd87b08488 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:55.118262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-f76af780-555b-49c2-b63b-b92e1ea58711 req-50dc958b-ad44-43a7-901a-bcdd87b08488 service nova] Creating event network-vif-deleted:79dc17dd-0f41-4a9f-9307-9de726b3d06e for instance 440d23f7-96c6-46ce-b2ff-147c4070509b on hv-cinder-85066 Jul 26 15:13:55.128163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-f76af780-555b-49c2-b63b-b92e1ea58711 req-50dc958b-ad44-43a7-901a-bcdd87b08488 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038928 Jul 26 15:13:55.133431 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 551/1083] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:55.792383 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:55.793959 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:55.800258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.800713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:55.801544 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.802341 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:56.059356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:56.069192 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:56.070830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:56.072159 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e71e5d68-9d14-48ae-9ebd-02c76a01ce49 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1752 microversion: 2.20 time: 0.284010 Jul 26 15:13:56.072957 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 533/1084] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:55 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1752 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:56.086205 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:56.087973 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:56.097343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:56.097908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:56.098770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:56.099316 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:56.182779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc5fd88556145fda1fb0067d5e9adcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0ab2fc6e64eada5f55a0f0a835073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:56.191311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6b1c9484-909d-42a5-8900-fa193de7cd6d tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 200 len: 1219 microversion: 2.1 time: 0.115639 Jul 26 15:13:56.192188 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 552/1085] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:56 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:57.097270 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:57.100083 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:57.108997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:57.109857 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:57.111352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:57.112016 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:57.225047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:57.238610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] [instance: 440d23f7-96c6-46ce-b2ff-147c4070509b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:57.276878 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:57.277396 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:57.278559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:57.279129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:57.295777 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] HTTP exception thrown: Instance 440d23f7-96c6-46ce-b2ff-147c4070509b could not be found. Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Request method failure captured: Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b HTTP/1.1 Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ANAeOAbX1TZBv2A6SCgh5Jam_POFG0yjDZAXUx1wfJxHH9b5HxRQU9sG5Op29wqRPDpiumcpQVwdxx_2K8OGLuRGCb5vZGHFjzQclLO6bjlNQZ791b0M80SCP1BJPQPRkzsXFwMgHVlmXTCM4-fBd-6blf78iUKdRPmzW-KaJoyPgs Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: a9f0ab2fc6e64eada5f55a0f0a835073 Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-TestShelveInstance-399459725 Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:13:57.297646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_a9f0ab2fc6e64eada5f55a0f0a835073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/a9f0ab2fc6e64eada5f55a0f0a835073"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/a9f0ab2fc6e64eada5f55a0f0a835073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/a9f0ab2fc6e64eada5f55a0f0a835073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-TestShelveInstance-399459725 Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: a9f0ab2fc6e64eada5f55a0f0a835073 Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-TestShelveInstance-399459725 Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-TestShelveInstance-399459725-project Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: 2fc5fd88556145fda1fb0067d5e9adcc Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-TestShelveInstance-399459725-project Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 440d23f7-96c6-46ce-b2ff-147c4070509b could not be found. Jul 26 15:13:57.299330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '440d23f7-96c6-46ce-b2ff-147c4070509b'} Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440d23f7-96c6-46ce-b2ff-147c4070509b could not be found. Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:57.300170 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440d23f7-96c6-46ce-b2ff-147c4070509b could not be found. Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440d23f7-96c6-46ce-b2ff-147c4070509b could not be found. Jul 26 15:13:57.301850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:13:57.304546 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Returning 404 to user: Instance 440d23f7-96c6-46ce-b2ff-147c4070509b could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:57.305520 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-086f93f7-d26c-4b26-8a59-1344ba01ed77 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b" status: 404 len: 111 microversion: 2.1 time: 0.092938 Jul 26 15:13:57.307282 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 553/1086] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:57 2022] GET /compute/v2.1/servers/440d23f7-96c6-46ce-b2ff-147c4070509b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:57.369344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:57.386849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:57.388611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:57.390358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a5ae7b25-b4b5-4029-8b59-6ccaf38e006a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.298254 Jul 26 15:13:57.396587 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 534/1087] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:57 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:13:57.793384 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-eea45b1b-e5d5-4a9d-a825-18032fe95454 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] Calling method '.version_select at 0x7f4532b88040>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:57.937332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-eea45b1b-e5d5-4a9d-a825-18032fe95454 tempest-TestShelveInstance-399459725 tempest-TestShelveInstance-399459725-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-158600999" status: 202 len: 0 microversion: 2.1 time: 0.148751 Jul 26 15:13:57.937909 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 554/1088] 10.222.0.94 () {58 vars in 1251 bytes} [Tue Jul 26 15:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-158600999 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:58.423989 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:58.425918 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:58.452098 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:58.452886 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:58.454496 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:58.455278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:58.737553 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:58.755190 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:58.768782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:58.768782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e7e445c4-8fa7-470a-ae8f-b594b4c0b9fd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.344447 Jul 26 15:13:58.768782 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 535/1089] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:58 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:13:59.794746 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:59.795811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:59.846848 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:59.847306 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:59.848124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:59.848564 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:00.277294 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:00.290659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:00.294321 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:00.296094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-33a7d9cc-403a-4569-acbc-2d287ce91140 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.509587 Jul 26 15:14:00.314845 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 555/1090] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:13:59 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:01.344630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:01.346716 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:01.360383 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:01.361869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:01.362975 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:01.363694 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:01.847123 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:01.862653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:01.865380 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:01.867074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-91ce29a3-c3a9-470e-b8e2-5de54b00b695 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.533695 Jul 26 15:14:01.888311 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 536/1091] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:01 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:02.900684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:02.902794 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:02.916559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:02.917402 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:02.918492 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:02.919094 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:03.155863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:03.170944 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:03.188756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:03.188756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e2521a97-ef62-4bc4-8fc8-c3d101bada26 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.285137 Jul 26 15:14:03.188756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 556/1092] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:02 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:04.210509 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:04.212766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:04.225599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:04.228997 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:04.229996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:04.230466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:04.570152 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:04.580570 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:04.582367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:04.583807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-efd0ffa3-479e-4b08-9d0c-4db14a6e66bc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.387402 Jul 26 15:14:04.590956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 537/1093] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:04 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:05.609127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:05.611021 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:05.628934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:05.630556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:05.631499 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:05.633218 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:06.146262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:06.158849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:06.161052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:06.162671 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-19b2586c-10e4-4ef7-8601-e2cbe801bf8e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.558076 Jul 26 15:14:06.164322 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 557/1094] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:05 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:07.194089 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:07.196996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:07.219133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:07.225011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:07.225011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:07.225011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:07.741926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:07.753011 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:07.754508 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:07.767949 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-43a0a2a4-443c-4950-84cb-ee043ea96cc6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.571696 Jul 26 15:14:07.783865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 538/1095] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:07 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:14:08.795381 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:08.796062 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:08.813329 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:08.813946 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:08.814783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:08.815223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:09.428262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:09.428262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:09.429025 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:09.429025 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-95e7b2e2-c40d-4d1e-ab19-534bbf6278dc tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.623179 Jul 26 15:14:09.429025 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 558/1096] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:08 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:10.454337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:10.455004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:10.463421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:10.463925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:10.464738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:10.465181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:10.901586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:10.911228 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:10.913034 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:10.914352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5bce860b-ff3a-42a7-974c-d8789371e7cd tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.464325 Jul 26 15:14:10.915136 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 539/1097] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:10 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:11.942215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:11.943966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:11.954740 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:11.955404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:11.956595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:11.957407 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:12.217341 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:12.230668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:12.234735 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:12.240104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-ee62165d-f77e-4d34-9677-7a482c4671c1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.303623 Jul 26 15:14:12.241079 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 559/1098] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:11 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:13.268984 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:13.270653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:13.281910 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=38 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:13.283547 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:13.284325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:13.285258 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:13.285867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:13.455324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:13.465166 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:13.467298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:13.468751 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b3716040-250d-4fb7-9da8-c02881cf3fd0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.206378 Jul 26 15:14:13.469759 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 540/1099] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:13 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:14.493528 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:14.494461 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:14.504808 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:14.509541 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:14.510625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:14.513519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:14.516252 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:14.772933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:14.783962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:14.785498 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:14.786760 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5161ed14-cf6e-4e5d-8bc7-99e46d20e4b3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.298287 Jul 26 15:14:14.788710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 560/1100] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:14 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:15.811869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:15.812483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:15.819875 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:15.820331 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:15.821648 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:15.822252 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:16.034494 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:16.046766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:16.048470 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:16.049671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5fa4d829-3680-4758-a5e8-7d470c04426a tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.241804 Jul 26 15:14:16.050235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 541/1101] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:15 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:17.085335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:17.086122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:17.088853 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:17.097051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:17.097051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:17.097051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:17.097051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:17.274090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:17.284357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:17.287184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:17.288650 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a26eef43-d260-47b8-bdb5-83dc35bffb3c tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.207462 Jul 26 15:14:17.291856 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 561/1102] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:17 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:18.319280 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:18.319925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:18.327978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:18.328462 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:18.329452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:18.329897 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:18.526485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:18.538629 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:18.542062 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:18.543306 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-72e7a406-7b6e-4729-9e20-f5444c829890 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.229576 Jul 26 15:14:18.563670 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 542/1103] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:18 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:19.580532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:19.580532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:19.593707 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:19.594152 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:19.594933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:19.595370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:19.840280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:19.848730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:19.850523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:19.852141 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-27801f17-f7c7-4f74-bae1-bc8892faf5de tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.282725 Jul 26 15:14:19.853075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 562/1104] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:19 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:19.861685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-b00d5fec-2c45-4f6a-bcb9-1ce84218c245 req-6922f0bf-b975-498b-85f9-6504efe40c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "name": "network-vif-plugged", "status": "completed", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:19.875157 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-b00d5fec-2c45-4f6a-bcb9-1ce84218c245 req-6922f0bf-b975-498b-85f9-6504efe40c0f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:19.875847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-b00d5fec-2c45-4f6a-bcb9-1ce84218c245 req-6922f0bf-b975-498b-85f9-6504efe40c0f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:19.880830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5aea8e67-c8ec-45d4-9444-c8d6518283c4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Action: 'create', calling method: .version_select at 0x7f4536aa9b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-432699790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKndZt+grHoT6APDAA/NL5SI3oGgdda8OokQEMhYOyhMxzQCF7piYiJK9lvwl5bjFg7qtM0+5WUK1l69wDVxQAgFis8+miwiBRHViPLhGdTKKsq0GgsbkqKgR64OVKvdHQ=="}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:19.896464 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-b00d5fec-2c45-4f6a-bcb9-1ce84218c245 req-6922f0bf-b975-498b-85f9-6504efe40c0f service nova] Creating event network-vif-plugged:914aac9d-0f65-4fef-a9cf-7ea754b0fa1d for instance 16ce9439-b753-41cb-a9b1-042db35be70b on hv-cinder-85066 Jul 26 15:14:19.906089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-b00d5fec-2c45-4f6a-bcb9-1ce84218c245 req-6922f0bf-b975-498b-85f9-6504efe40c0f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051535 Jul 26 15:14:19.910936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 563/1105] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:19.913142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-5aea8e67-c8ec-45d4-9444-c8d6518283c4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:14:19.918821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-5aea8e67-c8ec-45d4-9444-c8d6518283c4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for user c11f43d5614d46cd996789819075520d and project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'key_pairs'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:14:20.079451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5aea8e67-c8ec-45d4-9444-c8d6518283c4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.497773 Jul 26 15:14:20.080824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 543/1106] 10.222.0.94 () {60 vars in 1159 bytes} [Tue Jul 26 15:14:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:20.883814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:20.884726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:20.893908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:20.894361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:20.895167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:20.895685 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:21.065966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:21.075590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:21.077049 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:21.078562 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fcbd9433-dd6a-4fe1-86ea-dd5c8a011d60 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.202021 Jul 26 15:14:21.079038 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 564/1107] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:20 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:22.109344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:22.110817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:22.120641 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:22.121717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:22.123073 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:22.124042 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:22.130549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:22.286773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:22.297567 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:22.300356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:22.301879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-30815e76-1017-4e08-a991-41b940300d25 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.202187 Jul 26 15:14:22.302685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 544/1108] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:22 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:23.330259 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:23.331887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:23.342377 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:23.343089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:23.343963 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:23.344402 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:23.560662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:23.575232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:23.579560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:23.581953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d34dd9c0-bd73-41f7-b339-f14e0ef7b20f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.258421 Jul 26 15:14:23.583174 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 565/1109] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:23 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:24.608717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:24.609504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:24.617961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:24.618422 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:24.619197 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:24.619669 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:24.764458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:24.773039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:24.774664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:24.775854 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1973555e-8e74-4f7d-aacb-53216e01fb36 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.171169 Jul 26 15:14:24.776414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 545/1110] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:24 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:25.800503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:25.801253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:25.808424 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:25.808870 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:25.809642 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:25.810075 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:25.952013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:25.961400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:25.963199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:25.964494 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-5942061c-9239-4cf4-be6b-da225f868452 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1808 microversion: 2.20 time: 0.168166 Jul 26 15:14:25.965130 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 566/1111] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:25 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:26.989297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:26.989900 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:26.997805 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:26.999506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:26.999506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:26.999506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:27.142784 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:27.152164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:27.153734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:27.154919 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-88cf07b2-6afe-4eab-95a4-b44fdbd2fc40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1795 microversion: 2.20 time: 0.169740 Jul 26 15:14:27.155515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 546/1112] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:14:26 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1795 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:14:41.466328 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1632114708", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-432699790", "security_groups": [{"name": "tempest-secgroup-smoke-1921348991"}], "block_device_mapping_v2": [{"uuid": "9b53e55e-6c96-4912-9d46-873c4c1ca7d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987fc3bc-a943-4666-a158-3d1f2187f71f"}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:41.476283 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=11 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:41.476953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=37 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:41.582451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] validate_networks() for [('987fc3bc-a943-4666-a158-3d1f2187f71f', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:14:41.958658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:14:41.959093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:14:41.959817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:14:41.960240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:14:41.960658 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:14:41.969790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:41.970240 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:41.971047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:41.971497 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:41.989908 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:14:41.994594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for user c11f43d5614d46cd996789819075520d and project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:14:42.051042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:14:42.053169 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b53e55e-6c96-4912-9d46-873c4c1ca7d8',volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:14:42.581859 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-035857fd-2b4d-4e3a-95a8-60ebc6dc6c2d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.119384 Jul 26 15:14:42.582861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 567/1113] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:14:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:14:42.593795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-4c978ae7-4003-4d11-af19-cbebe77b9deb tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:42.594599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-4c978ae7-4003-4d11-af19-cbebe77b9deb tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:42.597060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=4 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.597730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.598362 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=17 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.652794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-4c978ae7-4003-4d11-af19-cbebe77b9deb tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:42.659561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-4c978ae7-4003-4d11-af19-cbebe77b9deb tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1094 microversion: 2.1 time: 0.069715 Jul 26 15:14:42.660133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 547/1114] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:42 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:14:43.683143 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-22da7c50-a959-4c5b-9ab6-73faf45fcbdd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:43.683767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-22da7c50-a959-4c5b-9ab6-73faf45fcbdd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:43.741418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-22da7c50-a959-4c5b-9ab6-73faf45fcbdd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:43.748405 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-22da7c50-a959-4c5b-9ab6-73faf45fcbdd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1094 microversion: 2.1 time: 0.070528 Jul 26 15:14:43.749035 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 568/1115] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:43 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:44.769330 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-44bf113d-8afd-421d-98cd-ab6e09a5dc26 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:44.769943 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-44bf113d-8afd-421d-98cd-ab6e09a5dc26 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:44.826459 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-44bf113d-8afd-421d-98cd-ab6e09a5dc26 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:44.833605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-44bf113d-8afd-421d-98cd-ab6e09a5dc26 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1094 microversion: 2.1 time: 0.068477 Jul 26 15:14:44.835870 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 548/1116] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:44 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:45.854604 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:45.855153 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:45.862010 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:45.862458 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:45.863249 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:45.863737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:46.091897 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:46.099297 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-15104e4f-1c25-441c-b928-3d7b26584e28 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1144 microversion: 2.1 time: 0.248806 Jul 26 15:14:46.099901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 569/1117] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:45 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1144 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:47.122592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:47.123196 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:47.129300 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:47.129772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:47.130523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:47.130956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:47.255614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:47.265381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ed613204-1b4d-447c-84a2-6ee2b0b6a82c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1192 microversion: 2.1 time: 0.147750 Jul 26 15:14:47.266308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 549/1118] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:47 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1192 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:48.288681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:48.289303 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:48.297055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:48.297523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:48.300040 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:48.300497 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:48.565824 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:48.575688 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d0d48910-97ec-47c2-80d3-52189b505006 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1278 microversion: 2.1 time: 0.290803 Jul 26 15:14:48.593466 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 570/1119] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:48 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1278 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:49.491266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-9849cd33-f933-4a61-a620-277512255039 req-6d4aee04-bbc6-4d54-b364-208c90c2e997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bbf918-a33a-4c1a-9a56-1705a2b1c349", "tag": "75a9e6b3-0609-419d-ab06-a0cc9c2d910c"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:49.503807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-9849cd33-f933-4a61-a620-277512255039 req-6d4aee04-bbc6-4d54-b364-208c90c2e997 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:49.504187 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-9849cd33-f933-4a61-a620-277512255039 req-6d4aee04-bbc6-4d54-b364-208c90c2e997 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:49.521071 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-9849cd33-f933-4a61-a620-277512255039 req-6d4aee04-bbc6-4d54-b364-208c90c2e997 service nova] Creating event network-changed:75a9e6b3-0609-419d-ab06-a0cc9c2d910c for instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 on hv-cinder-85066 Jul 26 15:14:49.530230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-9849cd33-f933-4a61-a620-277512255039 req-6d4aee04-bbc6-4d54-b364-208c90c2e997 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044343 Jul 26 15:14:49.530949 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 550/1120] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:49.602822 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:49.604589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:49.611674 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:49.612131 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:49.612919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:49.613360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:49.766693 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:49.775068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6f5b0c64-97bd-428c-b634-d9a6d9154579 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.178455 Jul 26 15:14:49.775679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 571/1121] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:49 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:50.797830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:50.798518 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:50.804957 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:50.805409 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:50.806238 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:50.806678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:50.950304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:50.956843 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-29bcf722-cdbe-42e8-aad7-35f9444a9a4c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.163749 Jul 26 15:14:50.957407 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 551/1122] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:50 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:51.978200 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:51.978820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:51.981154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:51.986330 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:51.986783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:51.987578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:51.988020 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:52.123165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:52.130634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-52529ce3-e898-4813-bec4-5b97d28ff30c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.156361 Jul 26 15:14:52.131324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 572/1123] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:51 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:53.152686 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:53.153319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:53.159950 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:53.160406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:53.161173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:53.161612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:53.297237 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:53.304798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c7a79220-31b2-4ff1-8cda-6878f51420f5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.156611 Jul 26 15:14:53.305448 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 552/1124] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:53 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:54.326841 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:54.327572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:54.329877 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=8 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:54.335758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:54.335758 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:54.336643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:54.337129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:54.475530 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:54.484625 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a52fdce4-1d51-4179-9bd6-6f2c1a9a1498 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.162120 Jul 26 15:14:54.485160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 573/1125] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:54 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:55.505952 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:55.506502 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:55.509390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=4 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:55.514436 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:55.514909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:55.515744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:55.516188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:55.652131 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:55.659721 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3fc4c346-aa0d-42f3-afa2-3e1d2c012ccc tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.157719 Jul 26 15:14:55.660290 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 553/1126] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:55 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:56.680655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:56.681420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:56.687935 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:56.688379 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:56.689142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:56.689716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:56.830920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:56.838735 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a5f8279d-affa-4573-86fc-42f485e29a6e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.162530 Jul 26 15:14:56.839299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 574/1127] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:56 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:57.859075 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:57.860007 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:57.867584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:57.868032 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:57.869715 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:57.870189 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:58.013640 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:58.021276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-2d8f05c3-ae61-4c3e-ac5b-da38b3aa1057 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.166089 Jul 26 15:14:58.021835 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 554/1128] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:57 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:59.042245 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:59.042851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:59.049558 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:59.050022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:59.050760 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:59.051194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:59.185942 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:59.194063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8946a219-aa87-4fa6-b05a-d1c18a2397d6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.155752 Jul 26 15:14:59.194641 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 575/1129] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:59 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:59.780464 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-3a6f9a18-d863-47ad-a840-04ba22134857 req-d724c57d-0388-429a-9b07-364b0b0d6779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bbf918-a33a-4c1a-9a56-1705a2b1c349", "name": "network-vif-plugged", "status": "completed", "tag": "75a9e6b3-0609-419d-ab06-a0cc9c2d910c"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:59.791837 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-3a6f9a18-d863-47ad-a840-04ba22134857 req-d724c57d-0388-429a-9b07-364b0b0d6779 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:59.792194 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-3a6f9a18-d863-47ad-a840-04ba22134857 req-d724c57d-0388-429a-9b07-364b0b0d6779 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:59.803371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-3a6f9a18-d863-47ad-a840-04ba22134857 req-d724c57d-0388-429a-9b07-364b0b0d6779 service nova] Creating event network-vif-plugged:75a9e6b3-0609-419d-ab06-a0cc9c2d910c for instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 on hv-cinder-85066 Jul 26 15:14:59.809034 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-3a6f9a18-d863-47ad-a840-04ba22134857 req-d724c57d-0388-429a-9b07-364b0b0d6779 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Jul 26 15:14:59.810185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 555/1130] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:00.216667 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:00.217257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:00.224321 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:00.224771 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:00.225887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:00.226334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:00.371387 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:00.379007 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-474832c2-6a48-4744-b7fc-3b1717d8590b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.168173 Jul 26 15:15:00.379591 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 576/1131] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:00 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:01.401297 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:01.402102 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:01.408188 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:01.408637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:01.409393 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:01.409826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:01.545716 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:01.553134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-00a6a5af-ee65-42db-b2c3-160c4e442d5b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1266 microversion: 2.1 time: 0.157270 Jul 26 15:15:01.553692 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 556/1132] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:01 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:02.575734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:02.576373 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:02.582700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:02.583172 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:02.583978 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:02.584418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:02.718397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:02.725982 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-af6c2ed2-ea36-46bf-9c35-586ba5f5ba5c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1453 microversion: 2.1 time: 0.155043 Jul 26 15:15:02.726546 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 577/1133] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:02 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:02.746915 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:02.747585 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:02.754808 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:02.755263 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:02.756070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:02.756508 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:02.888446 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:02.895883 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ce36dea6-4999-46a8-af6f-d5166db7a97e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1453 microversion: 2.1 time: 0.152943 Jul 26 15:15:02.896438 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 557/1134] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:02 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:05.062117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-9b81598d-9dba-407d-91b3-868ac0cafc24 req-433ed386-f927-4fd3-9065-3a0bc8e5e1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bbf918-a33a-4c1a-9a56-1705a2b1c349", "tag": "75a9e6b3-0609-419d-ab06-a0cc9c2d910c"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:05.073460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-9b81598d-9dba-407d-91b3-868ac0cafc24 req-433ed386-f927-4fd3-9065-3a0bc8e5e1ac service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:05.073977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-9b81598d-9dba-407d-91b3-868ac0cafc24 req-433ed386-f927-4fd3-9065-3a0bc8e5e1ac service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:05.086113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-9b81598d-9dba-407d-91b3-868ac0cafc24 req-433ed386-f927-4fd3-9065-3a0bc8e5e1ac service nova] Creating event network-changed:75a9e6b3-0609-419d-ab06-a0cc9c2d910c for instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 on hv-cinder-85066 Jul 26 15:15:05.092615 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-9b81598d-9dba-407d-91b3-868ac0cafc24 req-433ed386-f927-4fd3-9065-3a0bc8e5e1ac service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034569 Jul 26 15:15:05.093232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 578/1135] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:05.878319 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:05.879381 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:05.886753 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:05.887248 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:05.888049 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:05.888487 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:05.921730 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-35253044-a032-41c6-a750-bbfaa0b99763 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments/2db28cf6-043b-48d9-8f03-405ae56d15cc" status: 200 len: 194 microversion: 2.20 time: 0.047683 Jul 26 15:15:05.922335 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 558/1136] 10.222.0.94 () {60 vars in 1454 bytes} [Tue Jul 26 15:15:05 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments/2db28cf6-043b-48d9-8f03-405ae56d15cc => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:15:05.994537 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:05.995275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:06.002847 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:06.003291 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:06.004154 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:06.004589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:06.101036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lazy-loading 'services' on Instance uuid 16ce9439-b753-41cb-a9b1-042db35be70b {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:15:06.367885 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f2f8bd22-08d6-4cdd-98c5-f29df534ca06 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments/2db28cf6-043b-48d9-8f03-405ae56d15cc" status: 202 len: 0 microversion: 2.20 time: 0.377676 Jul 26 15:15:06.368409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 579/1137] 10.222.0.94 () {60 vars in 1457 bytes} [Tue Jul 26 15:15:05 2022] DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments/2db28cf6-043b-48d9-8f03-405ae56d15cc => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:15:06.376820 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:06.378991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:06.385794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:06.386202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:06.386981 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:06.387419 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:06.418361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-30e34fb1-c4fc-4476-8cbe-c1f411184fa1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045422 Jul 26 15:15:06.418926 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 559/1138] 10.222.0.94 () {60 vars in 1343 bytes} [Tue Jul 26 15:15:06 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:15:07.432936 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:07.435270 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:07.441486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:07.441922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:07.442681 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:07.443107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:07.472773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-cfe3b873-49cb-4ad6-be52-e8f47f8d2825 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046119 Jul 26 15:15:07.473351 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 580/1139] 10.222.0.94 () {60 vars in 1343 bytes} [Tue Jul 26 15:15:07 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:15:08.486212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:08.488385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:08.495313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:08.495798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:08.496561 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:08.497000 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:08.527202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-30d51acf-d044-4b53-a02b-eac7918e428d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045134 Jul 26 15:15:08.527795 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 560/1140] 10.222.0.94 () {60 vars in 1343 bytes} [Tue Jul 26 15:15:08 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:08.592335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:08.592876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:08.599235 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:08.599716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:08.600475 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:08.600905 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:08.629071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:15:09.015525 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-157d6e16-1dc2-4ba3-a2bd-b8d50a6a902f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 204 len: 0 microversion: 2.20 time: 0.427079 Jul 26 15:15:09.015755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 581/1141] 10.222.0.94 () {60 vars in 1280 bytes} [Tue Jul 26 15:15:08 2022] DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 15:15:09.028603 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:09.029214 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:09.036273 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:09.036725 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:09.037493 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:09.037931 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:09.170473 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:09.178612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:09.180153 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:09.181324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3feb202c-73d4-4b05-83b0-1b52535df892 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.160089 Jul 26 15:15:09.181860 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 561/1142] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:09 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:10.207339 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:10.208052 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:10.214809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:10.215894 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:10.216852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:10.217290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:10.357033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:10.365354 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:10.366857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:10.368055 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0d27e188-66e6-400b-a933-bc972c148a64 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.165019 Jul 26 15:15:10.368611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 582/1143] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:10 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:11.390845 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:11.391386 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:11.399358 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:11.399849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:11.400766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:11.401202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:11.635191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:11.645765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:11.647261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:11.648525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e92bf423-1b5f-4d87-b84a-c86f6371f748 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1723 microversion: 2.20 time: 0.262057 Jul 26 15:15:11.649304 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 562/1144] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:11 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:12.510076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-d788cd2a-424c-4600-82de-e9c075f6dafa req-d59aff7f-3a9f-4ee1-953b-5dbc0474a120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ce9439-b753-41cb-a9b1-042db35be70b", "name": "network-vif-deleted", "tag": "914aac9d-0f65-4fef-a9cf-7ea754b0fa1d"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:12.515668 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:12.522405 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-d788cd2a-424c-4600-82de-e9c075f6dafa req-d59aff7f-3a9f-4ee1-953b-5dbc0474a120 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:12.529392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-d788cd2a-424c-4600-82de-e9c075f6dafa req-d59aff7f-3a9f-4ee1-953b-5dbc0474a120 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:12.535168 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:12.537654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-d788cd2a-424c-4600-82de-e9c075f6dafa req-d59aff7f-3a9f-4ee1-953b-5dbc0474a120 service nova] Creating event network-vif-deleted:914aac9d-0f65-4fef-a9cf-7ea754b0fa1d for instance 16ce9439-b753-41cb-a9b1-042db35be70b on hv-cinder-85066 Jul 26 15:15:12.542989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-d788cd2a-424c-4600-82de-e9c075f6dafa req-d59aff7f-3a9f-4ee1-953b-5dbc0474a120 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036596 Jul 26 15:15:12.544300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 583/1145] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:15:12.674196 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:12.674794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:12.681432 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:12.681763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:12.682546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:12.682989 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:12.764696 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:12.772918 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:12.774671 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:12.775862 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-48636d5c-031e-45ed-ac4c-2812bc5f6e5b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 200 len: 1366 microversion: 2.20 time: 0.106340 Jul 26 15:15:12.776419 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 563/1146] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:12 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:13.801101 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:13.801933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:13.810269 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:13.810763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:13.811692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:13.812135 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:13.827298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] HTTP exception thrown: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Request method failure captured: Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b HTTP/1.1 Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ARGr1suShP9MioTVfhSKuv-z-22fQDkU15q-cWi47lUBBYdUdbVvTQpCsD63GHuq0DF9i5BPrDTLW7BPNYVTTYcv3sqZWlyWoZYrKeAfulLAhe83QCNB1R0i4rNJpcPKhO83ASVHuUty1sEbAMdSnzJYepCoD70dXvRHrMuLoA6tuM Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:15:13.829113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b57441fed5b5437581930346bf9116ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b57441fed5b5437581930346bf9116ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: b7e467910de54b7ea55cb2d728a8c9be Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:15:13.831068 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '16ce9439-b753-41cb-a9b1-042db35be70b'} Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:15:13.832022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:15:13.833343 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:15:13.834518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Returning 404 to user: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:15:13.834518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-03d5d1da-c1ce-495d-af10-3aa2e629b9ab tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 404 len: 111 microversion: 2.20 time: 0.034963 Jul 26 15:15:13.834518 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 584/1147] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:13 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 15:15:13.839861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cc3d6386-2c86-4fc1-b6f9-3c7aa5961c09 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '.version_select at 0x7f4536ad6ca0>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:13.923879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cc3d6386-2c86-4fc1-b6f9-3c7aa5961c09 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824095577" status: 204 len: 0 microversion: 2.20 time: 0.087634 Jul 26 15:15:13.924384 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 564/1148] 10.222.0.94 () {60 vars in 1259 bytes} [Tue Jul 26 15:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824095577 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:15:14.752508 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-f2958ea1-b9ee-40a0-87c6-9866f4be9236 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'create', calling method: .version_select at 0x7f4532d91280>, body: {"keypair": {"name": "tempest-keypair-757347438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp4k+Kn+3hyUYFF7PDBnvxFkXD9bd0TXeLbIBJqwlSh3zx/ftztsszqA4CaNN4XyrNVEHLp/lAwYOO8ntgFgJpzWRuDW7zV6eJAyzNs67GG8KseXXVgVO9YRJASTqk/IQ=="}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:14.769089 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-f2958ea1-b9ee-40a0-87c6-9866f4be9236 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for project b57441fed5b5437581930346bf9116ef. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:15:14.772851 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-f2958ea1-b9ee-40a0-87c6-9866f4be9236 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for user b7e467910de54b7ea55cb2d728a8c9be and project b57441fed5b5437581930346bf9116ef. Resources: {'key_pairs'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:15:14.958107 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-f2958ea1-b9ee-40a0-87c6-9866f4be9236 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.210147 Jul 26 15:15:14.958869 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 585/1149] 10.222.0.94 () {62 vars in 1200 bytes} [Tue Jul 26 15:15:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 212 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 15:15:17.916392 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1650552937", "imageRef": "0819f55d-4a7f-43f8-b4d9-e4ce0014f558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12e3290f-127b-470c-b462-095d0a9eadf0"}], "security_groups": [{"name": "tempest-securitygroup--636515929"}], "key_name": "tempest-keypair-757347438", "user_data": "}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:17.925849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:18.023729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] validate_networks() for [('12e3290f-127b-470c-b462-095d0a9eadf0', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:15:18.419830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:15:18.420435 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:15:18.421118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:15:18.423579 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:15:18.423579 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:15:18.431018 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:18.431481 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:18.432282 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:18.432735 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:18.439408 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=83 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:18.450901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for project b57441fed5b5437581930346bf9116ef. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:15:18.454980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Getting quotas for user b7e467910de54b7ea55cb2d728a8c9be and project b57441fed5b5437581930346bf9116ef. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:15:18.466459 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:15:18.468802 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0819f55d-4a7f-43f8-b4d9-e4ce0014f558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:15:18.662117 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-bc3bf6d5-6c0c-4b0c-bf54-73fe1f181067 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.750625 Jul 26 15:15:18.662891 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 565/1150] 10.222.0.94 () {62 vars in 1188 bytes} [Tue Jul 26 15:15:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 15:15:18.674886 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-21cffe9a-189c-4dde-a8da-b34611e481e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:18.675523 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-21cffe9a-189c-4dde-a8da-b34611e481e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:18.738342 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-21cffe9a-189c-4dde-a8da-b34611e481e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:18.747391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-21cffe9a-189c-4dde-a8da-b34611e481e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:18.749090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-21cffe9a-189c-4dde-a8da-b34611e481e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:18.750159 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-21cffe9a-189c-4dde-a8da-b34611e481e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1281 microversion: 2.20 time: 0.079979 Jul 26 15:15:18.750737 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 586/1151] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:18 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:19.773683 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:19.774301 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:19.781568 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:19.782013 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:19.782773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:19.783205 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:19.847909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:19.856946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:19.858218 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:19.859620 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f24d91eb-978e-4400-82d3-4409a60ab9e6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1285 microversion: 2.20 time: 0.090325 Jul 26 15:15:19.860176 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 566/1152] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:19 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:20.881895 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:20.882696 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:20.889684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:20.890122 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:20.890887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:20.891310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:20.961738 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:20.971278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:20.972949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:20.974097 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-96586c0a-def6-46c1-8bb7-7dd479a0e12e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1333 microversion: 2.20 time: 0.096132 Jul 26 15:15:20.974653 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 587/1153] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:20 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:21.998329 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:22.016316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:22.016316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:22.016316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:22.016316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:22.016783 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:22.265482 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:22.273663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:22.275181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:22.276352 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7faaa263-220b-4b73-835f-e61572b4510e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.282571 Jul 26 15:15:22.276893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 567/1154] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:21 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:23.208121 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-fa3108b4-a2a7-41bd-a174-bbcc7ae9233a req-dc53f06e-4d61-4c87-9b45-1f6de12c8be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:23.220134 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-fa3108b4-a2a7-41bd-a174-bbcc7ae9233a req-dc53f06e-4d61-4c87-9b45-1f6de12c8be5 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.220799 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-fa3108b4-a2a7-41bd-a174-bbcc7ae9233a req-dc53f06e-4d61-4c87-9b45-1f6de12c8be5 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.236104 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-fa3108b4-a2a7-41bd-a174-bbcc7ae9233a req-dc53f06e-4d61-4c87-9b45-1f6de12c8be5 service nova] Creating event network-changed:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:15:23.241220 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-fa3108b4-a2a7-41bd-a174-bbcc7ae9233a req-dc53f06e-4d61-4c87-9b45-1f6de12c8be5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039788 Jul 26 15:15:23.242290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 588/1155] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:23.301661 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:23.302978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:23.310039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.310608 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.311956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.312593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.522611 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.531804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.533326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.534441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e3533bc2-e7f5-4caa-acb8-0d20b7f4e918 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.237007 Jul 26 15:15:23.535003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 568/1156] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:23 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:24.559917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:24.560619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:24.567016 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:24.567488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:24.568262 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:24.568703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:24.709504 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:24.717649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:24.719184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:24.720340 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c0f4cf5f-55eb-468e-83fd-1506debe6aed tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.166069 Jul 26 15:15:24.720905 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 589/1157] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:24 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:25.744566 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:25.745181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:25.753253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:25.753722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:25.754498 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:25.754982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:25.899360 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:25.908914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:25.910463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:25.911644 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9760f86f-13b1-4bd6-8454-ee8b3d846c48 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.171277 Jul 26 15:15:25.912212 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 569/1158] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:25 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:26.933947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:26.934578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:26.941086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:26.941529 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:26.942287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:26.942716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:27.077329 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:27.085626 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:27.087124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:27.088271 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-273a85d4-aa82-474a-8e29-52ad22e55a61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.158407 Jul 26 15:15:27.088818 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 590/1159] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:26 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:27.962704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-84544d25-c131-4006-b369-3fe0c0b458f1 req-78100f94-372d-4d79-8fc1-be04dd35daff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "name": "network-vif-plugged", "status": "completed", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:27.973817 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-84544d25-c131-4006-b369-3fe0c0b458f1 req-78100f94-372d-4d79-8fc1-be04dd35daff service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:27.974066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-84544d25-c131-4006-b369-3fe0c0b458f1 req-78100f94-372d-4d79-8fc1-be04dd35daff service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:27.986772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-84544d25-c131-4006-b369-3fe0c0b458f1 req-78100f94-372d-4d79-8fc1-be04dd35daff service nova] Creating event network-vif-plugged:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:15:27.991798 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-84544d25-c131-4006-b369-3fe0c0b458f1 req-78100f94-372d-4d79-8fc1-be04dd35daff service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Jul 26 15:15:27.992436 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 570/1160] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:28.111624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:28.112249 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:28.118745 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:28.119296 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:28.120086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:28.120521 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:28.257032 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:28.266392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:28.268277 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:28.269426 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-b81bbdb8-84fd-4c5c-8dbd-5211b2d258a7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.163077 Jul 26 15:15:28.274744 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 591/1161] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:28 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:29.290320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:29.291255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=6 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:29.296704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:29.300344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:29.304355 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:29.304812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:29.305592 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:29.306031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:29.443233 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:29.451601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:29.453134 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:29.454241 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8e67a530-7f27-4258-89f3-52d1c8b68882 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1406 microversion: 2.20 time: 0.164915 Jul 26 15:15:29.454809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 571/1162] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:29 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:30.477098 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:30.477706 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:30.479664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=6 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:30.485779 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:30.486219 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:30.486978 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:30.487408 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:30.619364 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:30.627934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:30.629430 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:30.630666 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-829a3b69-016b-485a-9daf-6e316a71c395 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1598 microversion: 2.20 time: 0.157431 Jul 26 15:15:30.631127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 592/1163] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:15:30 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:15:30.652763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:30.653322 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:30.659898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:30.660345 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:30.661110 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:30.661549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:30.740208 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0b761993-ca08-4687-83d3-5b4d5f16555f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091322 Jul 26 15:15:30.740807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 572/1164] 10.222.0.94 () {60 vars in 1316 bytes} [Tue Jul 26 15:15:30 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:15:32.069151 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-64501701-8991-41a9-beb9-de4391773ed1 req-701e7f70-849b-4c53-8189-5949214d5b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:32.078594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-64501701-8991-41a9-beb9-de4391773ed1 req-701e7f70-849b-4c53-8189-5949214d5b07 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:32.079036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-64501701-8991-41a9-beb9-de4391773ed1 req-701e7f70-849b-4c53-8189-5949214d5b07 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:32.089998 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-64501701-8991-41a9-beb9-de4391773ed1 req-701e7f70-849b-4c53-8189-5949214d5b07 service nova] Creating event network-changed:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:15:32.095179 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-64501701-8991-41a9-beb9-de4391773ed1 req-701e7f70-849b-4c53-8189-5949214d5b07 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091382 Jul 26 15:15:32.095824 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 593/1165] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:16:08.006371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:08.007156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=37 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:08.011298 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:08.011847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:08.018193 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:08.020163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:08.020163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:08.020163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:08.044480 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-52983ba5-cf21-40fb-8e9a-ffa0ec53f00f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/ips" status: 200 len: 152 microversion: 2.20 time: 0.039411 Jul 26 15:16:08.045254 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 573/1166] 10.222.0.94 () {60 vars in 1289 bytes} [Tue Jul 26 15:16:08 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:16:11.046211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:11.047131 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=37 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:11.051631 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:16:11.052463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:11.058676 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:11.072117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:11.072117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:11.072117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:11.085024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lazy-loading 'flavor' on Instance uuid 035d6f9e-d20e-44df-b42e-ec33945e9269 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:16:11.709742 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-2b546008-3da2-427a-951d-65cd1cb0b43b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/action" status: 202 len: 0 microversion: 2.20 time: 0.666465 Jul 26 15:16:11.710435 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 594/1167] 10.222.0.94 () {62 vars in 1319 bytes} [Tue Jul 26 15:16:11 2022] POST /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:16:11.721285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:11.722220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:11.735454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:11.736213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:11.737542 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:11.738262 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:11.961619 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:11.973348 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:11.975274 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:11.976599 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a985fb39-8fbc-4105-ac7a-08df27caae54 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.261678 Jul 26 15:16:11.977222 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 574/1168] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:11 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:13.006333 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:13.007115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:13.014188 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:13.015415 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:13.016334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:13.016849 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:13.197437 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:13.206072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:13.207594 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:13.208795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fe6f943a-5b51-4245-9e37-764587ae380f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.208336 Jul 26 15:16:13.209349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 595/1169] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:12 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:14.237754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:14.238513 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:14.247192 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:14.247605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:14.248580 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:14.249722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:14.449831 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:14.459632 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:14.461139 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:14.462313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f03d77ff-7191-48d8-b951-e5f5d18cd3ae tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.229060 Jul 26 15:16:14.462872 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 575/1170] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:14 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:15.490352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:15.490949 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:15.497874 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:15.498341 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:15.499420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:15.499926 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:15.641486 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:15.650256 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:15.651871 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:15.653033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-978f8b12-0c6a-4c05-8496-2c7272a001ca tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.167611 Jul 26 15:16:15.653590 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 596/1171] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:15 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:16.678220 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:16.678823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:16.685595 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:16.686045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:16.686822 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:16.687277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:16.830108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:16.839473 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:16.840987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:16.842151 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-573c21c3-b618-4d8c-a3c4-51ed709b5d9d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.168665 Jul 26 15:16:16.842701 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 576/1172] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:16 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:17.870110 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:17.870724 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:17.877500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:17.878583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:17.879372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:17.879852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:18.021571 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:18.030183 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:18.031716 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:18.032873 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d897ed67-fa0f-40f6-b09f-c9eaa38e343d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.166784 Jul 26 15:16:18.033427 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 597/1173] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:17 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:19.056057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:19.056684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:19.063305 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:19.063809 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:19.064574 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:19.065012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:19.200031 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:19.208395 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:19.209901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:19.211056 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-472b7a04-6474-4237-b82d-c23a1a38fb1f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.158984 Jul 26 15:16:19.211642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 577/1174] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:19 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:20.235096 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:20.235864 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:20.242881 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:20.243439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:20.244479 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:20.244914 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:20.384896 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:20.393080 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:20.395165 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:20.396371 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d8a3c008-ccb3-4ff7-930a-f96e9f2ade6e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.165567 Jul 26 15:16:20.397128 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 598/1175] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:20 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:21.421215 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:21.422350 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:21.429302 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:21.429743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:21.430512 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:21.430940 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:21.575090 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:21.584778 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:21.586282 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:21.587731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1a25e959-e37f-4010-a028-6a5131cfbbf7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.170385 Jul 26 15:16:21.588375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 578/1176] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:21 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:22.615784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:22.616532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:22.624511 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:22.625045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:22.625876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:22.626300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:22.822210 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:22.830583 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:22.833171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:22.834376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-59f6feb0-8f55-4615-bcaf-bd91c6457f7d tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1744 microversion: 2.20 time: 0.224618 Jul 26 15:16:22.834933 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 599/1177] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:22 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:23.861275 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:23.861867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:23.868923 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:23.869375 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:23.870171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:23.870612 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:24.011770 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:24.020586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:24.022079 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:24.023299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-350ce977-9acd-410a-a5e3-acb9dac2c7fe tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1744 microversion: 2.20 time: 0.166197 Jul 26 15:16:24.023987 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 579/1178] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:23 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:25.047251 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:25.048105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:25.055697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:25.056199 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:25.057321 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:25.058761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:25.213322 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:25.227753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:25.229156 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:25.230485 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-7cadff97-f825-48f3-a661-4c38a2b5d923 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.187323 Jul 26 15:16:25.254217 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 600/1179] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:25 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:26.246982 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-d38da195-ed29-4152-9cf7-fbe50ba0a4fe req-2ca52504-9b9c-41e1-b3a9-0de0ea958ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "name": "network-vif-plugged", "status": "completed", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:16:26.262362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:26.263870 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:26.272074 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-d38da195-ed29-4152-9cf7-fbe50ba0a4fe req-2ca52504-9b9c-41e1-b3a9-0de0ea958ab2 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:26.283441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-d38da195-ed29-4152-9cf7-fbe50ba0a4fe req-2ca52504-9b9c-41e1-b3a9-0de0ea958ab2 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:26.283629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:26.283629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:26.283629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:26.283629 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:26.300163 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-d38da195-ed29-4152-9cf7-fbe50ba0a4fe req-2ca52504-9b9c-41e1-b3a9-0de0ea958ab2 service nova] Creating event network-vif-plugged:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:16:26.311162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-d38da195-ed29-4152-9cf7-fbe50ba0a4fe req-2ca52504-9b9c-41e1-b3a9-0de0ea958ab2 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145159 Jul 26 15:16:26.314064 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 580/1180] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:16:26.471369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:26.480762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:26.482975 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:26.484298 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-85ad3004-c458-48c9-87b4-a4c656157ff6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.226007 Jul 26 15:16:26.484938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 601/1181] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:26 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:27.531154 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:27.532070 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:27.542704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:27.543253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:27.544332 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:27.544844 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:27.731120 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:27.744160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:27.746527 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:27.748261 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-44b80be0-bbf2-48d8-9ee5-4df479e7eae5 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.222102 Jul 26 15:16:27.749666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 581/1182] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:27 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:28.777538 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:28.778187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:28.786184 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:28.787053 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:28.787880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:28.788534 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:29.041727 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:29.059577 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:29.062187 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:29.064789 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4c0b761b-573c-4039-8417-45f7d6fa8ca4 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.293082 Jul 26 15:16:29.066109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 602/1183] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:28 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:30.098614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:30.099556 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:30.108303 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:30.112836 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:30.115025 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:30.115643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:30.395546 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:30.412665 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:30.415958 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:30.418382 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-0f200aa1-68d5-417a-8cae-322a5d8ee153 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.325944 Jul 26 15:16:30.435582 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 582/1184] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:30 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:31.459327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:31.460185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:31.467843 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:31.468283 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:31.469063 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:31.469545 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:31.657956 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:31.670047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:31.672046 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:31.673473 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9fb069ee-8d63-4ab8-8f98-ea943d8a0a9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.218848 Jul 26 15:16:31.674198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 603/1185] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:31 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:32.703295 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:32.704510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:32.717588 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:32.718755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:32.720711 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:32.721597 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:32.938255 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:32.947687 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:32.949351 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:32.951849 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d9dd134a-47d7-4079-bae5-633e6cd94b7b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.253627 Jul 26 15:16:32.953666 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 583/1186] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:32 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:33.991811 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:33.993128 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:34.005472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:34.006142 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:34.007700 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:34.008639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:34.235618 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:34.259770 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:34.262175 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:34.263540 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d5a2fddd-40b5-4134-b8c7-5ffcea579aa0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.280424 Jul 26 15:16:34.264458 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 604/1187] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:33 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:35.297847 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:35.299024 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:35.312377 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:35.312675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:35.314077 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:35.314846 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:35.527388 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:35.538773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:35.540464 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:35.541693 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-51767b53-fad2-4a66-acce-79132a7f8f93 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.250694 Jul 26 15:16:35.542256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 584/1188] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:35 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:36.572251 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:36.573064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:36.582702 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:36.583444 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:36.584695 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:36.585768 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:36.744946 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:36.754065 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:36.755649 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:36.756839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-890b7f68-a064-47d5-9f49-705434c68ec1 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1739 microversion: 2.20 time: 0.191548 Jul 26 15:16:36.757409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 605/1189] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:36 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:37.781713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:37.782456 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:37.790522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:37.791071 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:37.792324 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:37.793022 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:37.950003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:37.958650 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:37.960192 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:37.961353 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-72160551-48b7-4bf4-813e-84ec6cefea61 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1721 microversion: 2.20 time: 0.183842 Jul 26 15:16:37.961899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 585/1190] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:37 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:38.986608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:38.987962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:38.994574 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:38.995019 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:38.995829 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:38.996268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:39.140265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:39.149797 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:39.151307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:39.152556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-321b5664-9757-4913-bf90-38f6de5e8009 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1721 microversion: 2.20 time: 0.169903 Jul 26 15:16:39.153108 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 606/1191] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:38 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:40.176019 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:40.176648 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:40.185038 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:40.185681 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:40.186586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:40.187191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:40.197132 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-16dc3431-cb93-47da-92ff-8a36cc04754f req-6f01b28f-b10c-48bd-864b-b78944d8e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "name": "network-vif-unplugged", "status": "completed", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:16:40.208222 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-16dc3431-cb93-47da-92ff-8a36cc04754f req-6f01b28f-b10c-48bd-864b-b78944d8e8da service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:40.208952 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-16dc3431-cb93-47da-92ff-8a36cc04754f req-6f01b28f-b10c-48bd-864b-b78944d8e8da service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:40.221202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-16dc3431-cb93-47da-92ff-8a36cc04754f req-6f01b28f-b10c-48bd-864b-b78944d8e8da service nova] Creating event network-vif-unplugged:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:16:40.226640 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-16dc3431-cb93-47da-92ff-8a36cc04754f req-6f01b28f-b10c-48bd-864b-b78944d8e8da service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033989 Jul 26 15:16:40.227491 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 607/1192] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:16:40.353806 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:40.363390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:40.365320 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:40.366340 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e5d0c922-8034-4217-b168-d6918d137c81 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1724 microversion: 2.20 time: 0.194883 Jul 26 15:16:40.376488 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 586/1193] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:40 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:40.395074 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5736bb83-f38d-431a-8f32-d87c2d185a71"}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:16:40.397557 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:40.405124 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:40.405575 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:40.406357 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:40.407492 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:40.495672 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:41.686218 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d4861a96-916c-48e0-a11d-714773556567 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.295607 Jul 26 15:16:41.686940 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 608/1194] 10.222.0.94 () {62 vars in 1364 bytes} [Tue Jul 26 15:16:40 2022] POST /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-volume_attachments => generated 188 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:16:41.819022 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:41.819754 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:41.822168 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=29 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:41.828053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:41.828772 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:41.829643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:41.830091 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:41.836359 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=79 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:42.543003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-a409271f-7b0f-4805-b7ae-223516ccf605 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-volume_attachments/5736bb83-f38d-431a-8f32-d87c2d185a71" status: 202 len: 0 microversion: 2.20 time: 0.728529 Jul 26 15:16:42.543672 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 587/1195] 10.222.0.94 () {60 vars in 1457 bytes} [Tue Jul 26 15:16:41 2022] DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-volume_attachments/5736bb83-f38d-431a-8f32-d87c2d185a71 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:16:42.607475 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:16:42.608044 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:42.610455 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=31 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:42.616327 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:42.616867 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:42.617661 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:42.618105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:42.877039 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-c97f61fb-2580-4910-b85e-0b01192917b0 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "POST /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/action" status: 202 len: 0 microversion: 2.20 time: 0.273888 Jul 26 15:16:42.877767 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 609/1196] 10.222.0.94 () {62 vars in 1319 bytes} [Tue Jul 26 15:16:42 2022] POST /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:16:42.886009 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:42.886629 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:42.894414 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:42.894869 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:42.895678 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:42.896118 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:43.041944 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:43.050751 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:43.053734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:43.057961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e0a2acdf-94df-4329-9c73-12b8e9264a17 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1672 microversion: 2.20 time: 0.173901 Jul 26 15:16:43.059250 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 588/1197] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:42 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:44.094280 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:44.095801 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:44.106580 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:44.107710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:44.109677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:44.109959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:44.251807 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:44.260417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:44.262058 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:44.263456 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4306ee05-3ce3-40a4-9242-75780d611c2f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1672 microversion: 2.20 time: 0.178171 Jul 26 15:16:44.264243 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 610/1198] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:44 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:45.288823 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:45.289564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:45.297181 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:45.297635 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:45.298406 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:45.298880 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:45.441370 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:45.450021 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:45.451552 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:45.452724 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-b55da951-52bb-4377-bc0e-eda34d85aca2 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.168377 Jul 26 15:16:45.453277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 589/1199] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:45 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:46.477972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:46.479197 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:46.485784 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:46.486258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:46.487023 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:46.487539 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:46.628417 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:46.637403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:46.639041 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:46.640253 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-09a096bb-b174-4da9-b32d-3ec076b9850e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.166442 Jul 26 15:16:46.640817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 611/1200] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:46 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:47.664198 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:47.665593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:47.672826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:47.673643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:47.674984 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:47.675668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:47.874458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:47.884600 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:47.886343 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:47.887591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cf5617c4-c156-4e2e-9f71-8484298f3566 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.227857 Jul 26 15:16:47.888162 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 590/1201] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:47 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:16:48.910391 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:48.911007 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:48.917947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:48.918442 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:48.919244 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:48.919726 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:49.062041 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:49.071082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:49.072680 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:49.074114 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-fac8f0a1-e77f-442a-8f8d-d5279d440624 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.167728 Jul 26 15:16:49.074682 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 612/1202] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:48 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:50.098470 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:50.099108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:50.106045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:50.106769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:50.107660 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:50.108236 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:50.255202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:50.263970 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:50.265488 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:50.266668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-795700d4-9829-4d66-bf38-2178faef5412 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.172236 Jul 26 15:16:50.267213 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 591/1203] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:50 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:51.289917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:51.290515 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:51.297756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:51.298560 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:51.299211 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:51.299773 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:51.450346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:51.465360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:51.467559 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:51.469655 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1a7936c4-30f8-41ce-ae79-c490e8fb53c6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.183666 Jul 26 15:16:51.471081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 613/1204] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:51 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:52.497865 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:52.500106 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:52.511729 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:52.512718 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:52.514052 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:52.514864 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:52.687797 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:52.697564 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:52.699237 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:52.700458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-7c3fa4a3-f32c-44b7-952c-36baf1450ca9 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.209933 Jul 26 15:16:52.701010 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 592/1205] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:52 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:53.727397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:53.728166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:53.735547 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:53.735990 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:53.736759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:53.737403 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:53.894791 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:53.904725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:53.906363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:53.908109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-007e3dae-0287-4c6c-a1b1-02bd4368f87b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.186322 Jul 26 15:16:53.925164 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 614/1206] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:53 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:54.933713 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:54.938076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:54.941579 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:54.942026 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:54.942803 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:54.943367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:55.100613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:55.109033 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:55.110515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:55.111773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-83a10b6d-d8ff-4f14-bb57-38e5dad8dc38 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.182471 Jul 26 15:16:55.112396 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 593/1207] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:54 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:56.136285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:56.136882 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:56.143659 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:56.144099 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:56.144858 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:56.145369 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:56.279588 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:56.290084 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:56.291604 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:56.292753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0df96d24-0966-4313-b686-a42e7a512f40 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.161213 Jul 26 15:16:56.293310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 615/1208] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:56 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:57.317451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:57.318102 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:57.325313 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:57.325792 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:57.326572 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:57.327003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:57.467171 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:57.475066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:57.476975 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:57.478133 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6cfdb3aa-789a-44f6-848d-8982ed762697 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.164822 Jul 26 15:16:57.478684 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 594/1209] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:57 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:58.502257 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:58.502903 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:58.509452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:58.509886 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:58.510686 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:58.511119 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:58.644278 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:58.652989 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:58.654535 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:58.655753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-67103839-9310-4de5-849a-5bea5f22f959 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.157466 Jul 26 15:16:58.656311 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 616/1210] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:58 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:16:59.679893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:16:59.680606 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:16:59.687326 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:59.687956 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:59.688790 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:16:59.689230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:16:59.836401 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:59.847757 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:59.851742 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:16:59.853141 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-104bff50-92e2-4442-a0d5-6a0a52ad0f9b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.177947 Jul 26 15:16:59.853785 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 595/1211] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:16:59 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:00.470917 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-bf2abde8-c5c2-4ffa-85f7-c50b7699a8fe req-1d109dad-69a0-46ce-9957-f2276cd87c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "name": "network-vif-plugged", "status": "completed", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:00.481734 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-bf2abde8-c5c2-4ffa-85f7-c50b7699a8fe req-1d109dad-69a0-46ce-9957-f2276cd87c91 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:00.482171 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-bf2abde8-c5c2-4ffa-85f7-c50b7699a8fe req-1d109dad-69a0-46ce-9957-f2276cd87c91 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:00.496595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-bf2abde8-c5c2-4ffa-85f7-c50b7699a8fe req-1d109dad-69a0-46ce-9957-f2276cd87c91 service nova] Creating event network-vif-plugged:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:17:00.501715 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-bf2abde8-c5c2-4ffa-85f7-c50b7699a8fe req-1d109dad-69a0-46ce-9957-f2276cd87c91 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034463 Jul 26 15:17:00.502500 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 617/1212] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:17:00.885765 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:00.886434 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:00.893282 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:00.893724 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:00.894526 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:00.894985 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:01.030512 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:01.039129 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:01.040709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:01.041930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f9f27973-a0b9-4f7c-8b54-4b1af6ee68d3 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.161184 Jul 26 15:17:01.042483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 596/1213] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:00 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:02.066215 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:02.066973 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:02.074763 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:02.075213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:02.076029 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:02.076469 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:02.477972 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:02.486750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:02.488287 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:02.489510 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3895dc8c-57de-4251-8c17-55c3a6f85447 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.427543 Jul 26 15:17:02.490059 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 618/1214] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:02 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:03.514202 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:03.514768 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:03.521343 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:03.521801 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:03.522771 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:03.523217 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:03.663399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:03.672518 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:03.674225 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:03.675604 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e1564a1f-c1ec-40fe-bce7-9c8768d71b4b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1730 microversion: 2.20 time: 0.165458 Jul 26 15:17:03.676184 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 597/1215] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:03 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:04.699394 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:04.700042 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:04.706267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:04.706721 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:04.707510 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:04.707953 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:04.838449 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:04.846725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:04.848267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:04.849470 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-3869f7ef-8aa7-4070-8662-bbac1b17519f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1717 microversion: 2.20 time: 0.154031 Jul 26 15:17:04.850540 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 619/1216] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:04 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:17:04.911302 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:04.911996 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:04.919233 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:04.919717 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:04.920485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:04.920922 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:04.947532 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:17:05.314909 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1209265c-7965-4667-87c8-2ddade629701 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "DELETE /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 204 len: 0 microversion: 2.1 time: 0.407136 Jul 26 15:17:05.315534 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 598/1217] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:17:04 2022] DELETE /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:17:05.324413 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:05.325046 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:05.331115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:05.331601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:05.332362 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:05.332795 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:05.473892 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:05.481854 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-28f79dca-632f-4f3f-bdc8-4f1446ecad55 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1578 microversion: 2.1 time: 0.161545 Jul 26 15:17:05.482423 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 620/1218] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:05 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:06.504294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:06.505020 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:06.511614 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:06.512101 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:06.512890 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:06.513330 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:06.532731 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:06.653705 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:06.661142 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cb4bde65-cb7e-4397-8945-81e6aa48de5d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1578 microversion: 2.1 time: 0.161367 Jul 26 15:17:06.661706 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 599/1219] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:06 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:07.682790 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:07.683402 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:07.690627 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:07.691127 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:07.691945 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:07.692398 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:07.771774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:07.780194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-054902ab-bf08-474a-b4e2-39ca6bd4b0bd tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1510 microversion: 2.1 time: 0.101723 Jul 26 15:17:07.782115 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 621/1220] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:07 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:07.999601 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-f18a4be4-e09f-4106-9732-b9593ac141c5 req-445d5c25-cc4e-42cc-ae0b-89563a69a0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bbf918-a33a-4c1a-9a56-1705a2b1c349", "name": "network-vif-deleted", "tag": "75a9e6b3-0609-419d-ab06-a0cc9c2d910c"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:08.010675 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-f18a4be4-e09f-4106-9732-b9593ac141c5 req-445d5c25-cc4e-42cc-ae0b-89563a69a0f4 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:08.011621 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-f18a4be4-e09f-4106-9732-b9593ac141c5 req-445d5c25-cc4e-42cc-ae0b-89563a69a0f4 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:08.023945 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-f18a4be4-e09f-4106-9732-b9593ac141c5 req-445d5c25-cc4e-42cc-ae0b-89563a69a0f4 service nova] Creating event network-vif-deleted:75a9e6b3-0609-419d-ab06-a0cc9c2d910c for instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 on hv-cinder-85066 Jul 26 15:17:08.028867 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-f18a4be4-e09f-4106-9732-b9593ac141c5 req-445d5c25-cc4e-42cc-ae0b-89563a69a0f4 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Jul 26 15:17:08.029581 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 600/1221] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:17:08.802610 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:08.804163 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:08.811093 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:08.811581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:08.812363 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:08.812800 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:08.847216 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:08.847692 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:08.848182 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lazy-loading 'fault' on Instance uuid 96bbf918-a33a-4c1a-9a56-1705a2b1c349 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:17:08.852005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:08.896129 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:08.902386 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e3756226-3bc5-4045-bf9c-6d86dde30b6d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 200 len: 1230 microversion: 2.1 time: 0.104019 Jul 26 15:17:08.903000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 622/1222] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:08 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:09.925433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:09.926123 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:09.932989 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:09.933485 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:09.934266 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:09.934704 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:09.948755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] HTTP exception thrown: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Request method failure captured: Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 HTTP/1.1 Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ATC_X4VTXMISzaQyhtch01fHngxkTuuxuMjkN3ZOx5NC15GZedtPf9BjBPzWIa1bqXSznEXDeeOnOhDj3lsjMP6d3pf0S_8-K0ELZEd6oexWnMO0r0rdMZFgiC1qkAJ30wNGQx_zVOIQ54YA5PxaCrC0Z1okjf06I6bRSP8p_tpMSs Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:17:09.950385 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-TestVolumeBootPattern-334829638 Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: c11f43d5614d46cd996789819075520d Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:17:09.952053 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '96bbf918-a33a-4c1a-9a56-1705a2b1c349'} Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:17:09.953087 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:17:09.954613 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:09.956045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Returning 404 to user: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:17:09.956045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f8ba1318-ce14-42e7-9cf8-0c40e659f844 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 404 len: 111 microversion: 2.1 time: 0.031389 Jul 26 15:17:09.956045 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 601/1223] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:09 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:17:10.003352 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-584948995", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-432699790", "security_groups": [{"name": "tempest-secgroup-smoke-1921348991"}], "block_device_mapping_v2": [{"uuid": "9b53e55e-6c96-4912-9d46-873c4c1ca7d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987fc3bc-a943-4666-a158-3d1f2187f71f"}]}} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:10.119783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.network.neutron [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] validate_networks() for [('987fc3bc-a943-4666-a158-3d1f2187f71f', None, None, None, None, None)] {{(pid=130762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:17:10.569416 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Flavor limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:17:10.569839 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Image limits 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:17:10.570313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Flavor pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:17:10.570725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Image pref 0:0:0 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:17:10.571310 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.virt.hardware [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:17:10.580086 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:10.580531 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:10.581337 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:10.581774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:10.598434 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:17:10.603022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.quota [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for user c11f43d5614d46cd996789819075520d and project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'ram', 'instances', 'cores'} {{(pid=130762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:17:10.660463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Going to run 1 instances... {{(pid=130762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:17:10.663013 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b53e55e-6c96-4912-9d46-873c4c1ca7d8',volume_size=None,volume_type=None)] {{(pid=130762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:17:11.111967 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8925558c-e348-4771-9a2b-31290942f710 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.112363 Jul 26 15:17:11.112639 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 623/1224] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:17:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:17:11.124067 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-85744da7-27a7-4461-9c88-f7d6aa0cfe40 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:11.124773 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-85744da7-27a7-4461-9c88-f7d6aa0cfe40 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:11.187116 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-85744da7-27a7-4461-9c88-f7d6aa0cfe40 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:11.197864 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-85744da7-27a7-4461-9c88-f7d6aa0cfe40 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1093 microversion: 2.1 time: 0.077939 Jul 26 15:17:11.201791 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 602/1225] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:11 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:12.223324 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:12.223973 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:12.230876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:12.231617 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:12.232453 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:12.232880 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:12.299140 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:12.307934 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-feed62a7-62ff-43e5-9325-e2193378cf69 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1143 microversion: 2.1 time: 0.088907 Jul 26 15:17:12.308533 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 624/1226] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:12 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:13.329637 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:13.330306 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:13.332788 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:13.338463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:13.338915 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:13.339728 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:13.340631 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:13.424595 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:13.432586 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1d3658f0-a4ee-4d7d-a6f0-d788d4f20aa0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1199 microversion: 2.1 time: 0.107144 Jul 26 15:17:13.433147 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 603/1227] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:13 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:14.454728 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:14.457002 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:14.458004 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:14.463033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:14.463503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:14.464275 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:14.464774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:14.613128 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:14.622503 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8c9cff98-a02f-4a20-b0d5-6b68e396e010 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1277 microversion: 2.1 time: 0.171862 Jul 26 15:17:14.623349 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 625/1228] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:14 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:15.641818 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-0d9c1199-3c56-4c48-9f4f-e67fef5e83b6 req-9cbee832-ea07-49dc-bdcb-2d12a192cc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2ab780-c607-449f-9f92-fe2110637abf", "tag": "cc7346d4-6d21-435c-9ce5-c47d964c5453"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:15.647072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:15.648608 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:15.656566 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:15.657198 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:15.658117 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:15.658275 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0d9c1199-3c56-4c48-9f4f-e67fef5e83b6 req-9cbee832-ea07-49dc-bdcb-2d12a192cc99 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:15.658642 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:15.658761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-0d9c1199-3c56-4c48-9f4f-e67fef5e83b6 req-9cbee832-ea07-49dc-bdcb-2d12a192cc99 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:15.671794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-0d9c1199-3c56-4c48-9f4f-e67fef5e83b6 req-9cbee832-ea07-49dc-bdcb-2d12a192cc99 service nova] Creating event network-changed:cc7346d4-6d21-435c-9ce5-c47d964c5453 for instance fd2ab780-c607-449f-9f92-fe2110637abf on hv-cinder-85066 Jul 26 15:17:15.678389 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-0d9c1199-3c56-4c48-9f4f-e67fef5e83b6 req-9cbee832-ea07-49dc-bdcb-2d12a192cc99 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040526 Jul 26 15:17:15.679257 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 604/1229] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:17:15.817679 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:15.826361 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-4f2c7b1e-7ea3-4a5e-ae86-25bc04fd2d37 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.183187 Jul 26 15:17:15.840844 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 626/1230] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:15 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:17:16.849826 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:16.850674 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:16.857706 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:16.858167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:16.858932 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:16.859399 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:16.999369 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:17.007897 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-09236fb2-f77f-4086-a6c7-09b15a3245c7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.163244 Jul 26 15:17:17.008450 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 605/1231] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:16 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:18.029923 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:18.030525 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:18.037309 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:18.037757 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:18.039037 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:18.039759 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:18.172081 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:18.181080 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-361d3ffb-661d-4f6d-8f24-902a09f34aaf tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.155006 Jul 26 15:17:18.181651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 627/1232] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:18 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:19.202367 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:19.202961 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:19.209722 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:19.210191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:19.210947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:19.211376 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:19.352005 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:19.359830 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ef1142e6-f076-4176-8df2-25a3a5acbeca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.161271 Jul 26 15:17:19.360493 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 606/1233] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:19 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:20.381346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:20.381959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:20.388643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:20.389082 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:20.389842 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:20.390273 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:20.528451 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:20.535855 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-271f3416-aa78-4122-8cec-ae5811f92991 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.158664 Jul 26 15:17:20.536414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 628/1234] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:20 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:21.557602 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:21.558345 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:21.561452 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:21.565035 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:21.568610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:21.568610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:21.568610 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:21.712967 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:21.720789 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-c5f96d54-f711-4d5d-a906-d3aac0d1b95f tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.167181 Jul 26 15:17:21.721374 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 607/1235] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:21 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:22.743619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:22.744307 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:22.746223 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:22.746919 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=6 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:22.752576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:22.753026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:22.753809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:22.754248 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:22.922990 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:22.930710 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1ea3cfbe-5dad-43dc-801a-b8c3b1f14fb6 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.192361 Jul 26 15:17:22.931299 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 629/1236] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:22 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:23.952355 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:23.952903 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:23.959640 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:23.960004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:23.960769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:23.961203 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:24.095088 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:24.103618 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9efcabdc-e407-4fbf-bc08-af7ebe00b13d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.155196 Jul 26 15:17:24.104185 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 608/1237] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:23 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:25.124819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:25.125490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:25.132018 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:25.132463 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:25.133238 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:25.133667 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:25.270232 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:25.278929 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-aa636807-20fc-4461-97b8-8da998cc0071 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.158128 Jul 26 15:17:25.279531 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 630/1238] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:25 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:26.301075 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:26.301689 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:26.308947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:26.309565 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:26.310537 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:26.310986 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:26.452665 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:26.461875 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-e3006d89-cd84-4aaf-b180-b3f20c559ad1 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.164606 Jul 26 15:17:26.462462 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 609/1239] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:26 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:26.544487 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-fcd6276b-f35d-4303-a6bc-85b1678fbce0 req-44884f77-e175-492b-a853-58025a0ad539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2ab780-c607-449f-9f92-fe2110637abf", "name": "network-vif-plugged", "status": "completed", "tag": "cc7346d4-6d21-435c-9ce5-c47d964c5453"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:26.555586 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-fcd6276b-f35d-4303-a6bc-85b1678fbce0 req-44884f77-e175-492b-a853-58025a0ad539 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:26.556022 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-fcd6276b-f35d-4303-a6bc-85b1678fbce0 req-44884f77-e175-492b-a853-58025a0ad539 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:26.570446 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-fcd6276b-f35d-4303-a6bc-85b1678fbce0 req-44884f77-e175-492b-a853-58025a0ad539 service nova] Creating event network-vif-plugged:cc7346d4-6d21-435c-9ce5-c47d964c5453 for instance fd2ab780-c607-449f-9f92-fe2110637abf on hv-cinder-85066 Jul 26 15:17:26.575558 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-fcd6276b-f35d-4303-a6bc-85b1678fbce0 req-44884f77-e175-492b-a853-58025a0ad539 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035837 Jul 26 15:17:26.579904 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 631/1240] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:17:27.484398 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:27.485044 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:27.491878 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:27.492336 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:27.493108 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:27.493541 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:27.632361 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:27.640177 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-9c7cc678-f5a4-458b-a4f3-acdb746434b4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.160781 Jul 26 15:17:27.640761 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 610/1241] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:27 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:17:28.663703 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:28.664400 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:28.670861 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:28.671300 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:28.672100 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:28.672532 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:28.815226 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:28.823285 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-dc7ed6bc-7427-4957-bc40-46912458bdb2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1265 microversion: 2.1 time: 0.164645 Jul 26 15:17:28.823948 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 632/1242] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:28 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:29.844273 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:29.844908 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:29.851402 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:29.851875 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:29.852630 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:29.853063 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:29.991455 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:29.999769 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-df1cbeea-600d-477c-bea2-cdab13e9c2d4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1452 microversion: 2.1 time: 0.159395 Jul 26 15:17:30.000346 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 611/1243] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:29 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:30.020601 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:30.021206 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:30.028516 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:30.028964 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:30.029730 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:30.030160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:30.171731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:30.180831 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0449901d-b81f-4983-bd2d-47ca34a5f9b8 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1452 microversion: 2.1 time: 0.164013 Jul 26 15:17:30.181401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 633/1244] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:30 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:32.350285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-af84b077-0ff2-42d7-a38c-066683fea1f7 req-79d891f0-a491-4650-a3bd-87c150bd7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2ab780-c607-449f-9f92-fe2110637abf", "tag": "cc7346d4-6d21-435c-9ce5-c47d964c5453"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:32.362506 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-af84b077-0ff2-42d7-a38c-066683fea1f7 req-79d891f0-a491-4650-a3bd-87c150bd7a1e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:32.362994 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-af84b077-0ff2-42d7-a38c-066683fea1f7 req-79d891f0-a491-4650-a3bd-87c150bd7a1e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:32.375864 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-af84b077-0ff2-42d7-a38c-066683fea1f7 req-79d891f0-a491-4650-a3bd-87c150bd7a1e service nova] Creating event network-changed:cc7346d4-6d21-435c-9ce5-c47d964c5453 for instance fd2ab780-c607-449f-9f92-fe2110637abf on hv-cinder-85066 Jul 26 15:17:32.381647 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-af84b077-0ff2-42d7-a38c-066683fea1f7 req-79d891f0-a491-4650-a3bd-87c150bd7a1e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035233 Jul 26 15:17:32.382466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 612/1245] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:17:37.828332 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:37.830556 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:37.837072 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:37.837462 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:37.838231 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:37.838664 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:37.868293 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-97ca3447-879f-429a-bfaf-7daa13dcc97e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044437 Jul 26 15:17:37.868850 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 634/1246] 10.222.0.94 () {60 vars in 1343 bytes} [Tue Jul 26 15:17:37 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:37.932403 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:37.932925 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:37.939309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:37.939788 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:37.940549 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:37.940986 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:37.967173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:17:38.337006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d558a073-f541-424f-bd12-cf889d27ed4e tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 204 len: 0 microversion: 2.20 time: 0.409186 Jul 26 15:17:38.337602 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 613/1247] 10.222.0.94 () {60 vars in 1280 bytes} [Tue Jul 26 15:17:37 2022] DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:17:38.346166 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:38.346947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:38.353313 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:38.353762 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:38.354543 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:38.355756 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:38.497190 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:38.505065 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:38.506498 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:38.507683 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-d9acaa5f-9097-4db1-b05f-374b3e91ad9f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.165439 Jul 26 15:17:38.508755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 635/1248] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:38 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:39.531974 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:39.532683 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:39.539194 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:39.539685 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:39.540458 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:39.540901 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:39.678689 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:39.687794 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:39.689299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:39.690451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-3509ea40-6bca-4cf2-bbd9-5b49123e9688 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.162830 Jul 26 15:17:39.691006 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 614/1249] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:39 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:40.715074 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:40.715660 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:40.723488 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:40.723754 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:40.724540 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:40.725161 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:40.729439 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=73 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:40.860698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:40.868922 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:40.871005 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:40.872414 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-14262a53-13b2-4804-b435-053449455049 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1723 microversion: 2.20 time: 0.162024 Jul 26 15:17:40.872976 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 636/1250] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:40 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:41.203577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-173de036-cfca-4862-be07-6ee170b340e5 req-e4302010-e24c-4a90-9790-79ead55a3e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035d6f9e-d20e-44df-b42e-ec33945e9269", "name": "network-vif-deleted", "tag": "6a8b8d94-4686-4ed2-a4de-5c9c73088dca"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:41.213893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-173de036-cfca-4862-be07-6ee170b340e5 req-e4302010-e24c-4a90-9790-79ead55a3e88 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:41.214762 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-173de036-cfca-4862-be07-6ee170b340e5 req-e4302010-e24c-4a90-9790-79ead55a3e88 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:41.218979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:41.227076 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-173de036-cfca-4862-be07-6ee170b340e5 req-e4302010-e24c-4a90-9790-79ead55a3e88 service nova] Creating event network-vif-deleted:6a8b8d94-4686-4ed2-a4de-5c9c73088dca for instance 035d6f9e-d20e-44df-b42e-ec33945e9269 on hv-cinder-85066 Jul 26 15:17:41.232892 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-173de036-cfca-4862-be07-6ee170b340e5 req-e4302010-e24c-4a90-9790-79ead55a3e88 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034615 Jul 26 15:17:41.233846 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 615/1251] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:17:41.895835 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:41.896456 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:41.903870 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:41.904322 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:41.905194 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:41.905632 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:41.944662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:41.945158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:41.945810 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lazy-loading 'fault' on Instance uuid 035d6f9e-d20e-44df-b42e-ec33945e9269 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:17:41.988634 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:41.997113 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:41.998624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e467910de54b7ea55cb2d728a8c9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57441fed5b5437581930346bf9116ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:41.999827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-22dd0d4a-d066-436b-b8a8-6fa09376db0b tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 200 len: 1371 microversion: 2.20 time: 0.107973 Jul 26 15:17:42.000376 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 637/1252] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:41 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:17:43.025072 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:43.025762 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:43.033111 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:43.033560 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:43.034325 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:43.034763 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:43.048356 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] HTTP exception thrown: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Request method failure captured: Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 HTTP/1.1 Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ARGr1suShP9MioTVfhSKuv-z-22fQDkU15q-cWi47lUBBYdUdbVvTQpCsD63GHuq0DF9i5BPrDTLW7BPNYVTTYcv3sqZWlyWoZYrKeAfulLAhe83QCNB1R0i4rNJpcPKhO83ASVHuUty1sEbAMdSnzJYepCoD70dXvRHrMuLoA6tuM Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:17:43.049979 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b57441fed5b5437581930346bf9116ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b57441fed5b5437581930346bf9116ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: b7e467910de54b7ea55cb2d728a8c9be Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:43.051737 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '035d6f9e-d20e-44df-b42e-ec33945e9269'} Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:17:43.052738 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:43.054442 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:43.055861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Returning 404 to user: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:17:43.055861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-493d3e80-0106-4703-afa0-32f58959acbb tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 404 len: 111 microversion: 2.20 time: 0.031526 Jul 26 15:17:43.055861 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 616/1253] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:43 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:17:43.060714 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9f21238c-313f-4432-a92c-0c09fb974c28 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '.version_select at 0x7f4532979040>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:43.143568 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9f21238c-313f-4432-a92c-0c09fb974c28 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757347438" status: 204 len: 0 microversion: 2.20 time: 0.086755 Jul 26 15:17:43.144105 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 638/1254] 10.222.0.94 () {60 vars in 1259 bytes} [Tue Jul 26 15:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757347438 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:17:45.285688 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:45.286277 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:45.294368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:45.294821 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:45.304575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:45.304575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:45.312882 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] HTTP exception thrown: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Request method failure captured: Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 HTTP/1.1 Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ARGr1suShP9MioTVfhSKuv-z-22fQDkU15q-cWi47lUBBYdUdbVvTQpCsD63GHuq0DF9i5BPrDTLW7BPNYVTTYcv3sqZWlyWoZYrKeAfulLAhe83QCNB1R0i4rNJpcPKhO83ASVHuUty1sEbAMdSnzJYepCoD70dXvRHrMuLoA6tuM Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:17:45.314451 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b57441fed5b5437581930346bf9116ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b57441fed5b5437581930346bf9116ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: b7e467910de54b7ea55cb2d728a8c9be Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.316160 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '035d6f9e-d20e-44df-b42e-ec33945e9269'} Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:17:45.317157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.318457 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.320253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Returning 404 to user: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:17:45.320253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-781991d6-6405-4c51-ba8a-b41e4f0716e7 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 404 len: 111 microversion: 2.20 time: 0.034458 Jul 26 15:17:45.320253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 617/1255] 10.222.0.94 () {60 vars in 1280 bytes} [Tue Jul 26 15:17:45 2022] DELETE /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 15:17:45.325643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:45.326265 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 035d6f9e-d20e-44df-b42e-ec33945e9269] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:45.333459 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:45.333920 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:45.334731 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:45.335173 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:45.351045 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] HTTP exception thrown: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Request method failure captured: Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 HTTP/1.1 Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ARGr1suShP9MioTVfhSKuv-z-22fQDkU15q-cWi47lUBBYdUdbVvTQpCsD63GHuq0DF9i5BPrDTLW7BPNYVTTYcv3sqZWlyWoZYrKeAfulLAhe83QCNB1R0i4rNJpcPKhO83ASVHuUty1sEbAMdSnzJYepCoD70dXvRHrMuLoA6tuM Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:17:45.352764 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b57441fed5b5437581930346bf9116ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b57441fed5b5437581930346bf9116ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: b7e467910de54b7ea55cb2d728a8c9be Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.354346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '035d6f9e-d20e-44df-b42e-ec33945e9269'} Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:17:45.356295 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. Jul 26 15:17:45.357806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:45.359509 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Returning 404 to user: Instance 035d6f9e-d20e-44df-b42e-ec33945e9269 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:17:45.359509 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-9a5f9430-f934-4037-8510-6c35fb3a4d41 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269" status: 404 len: 111 microversion: 2.20 time: 0.033545 Jul 26 15:17:45.359509 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 639/1256] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:45 2022] GET /compute/v2.1/servers/035d6f9e-d20e-44df-b42e-ec33945e9269 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:17:46.625766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:46.626334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:46.633235 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:46.638719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:46.638719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:46.638719 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:46.649218 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] HTTP exception thrown: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Request method failure captured: Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b HTTP/1.1 Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ARGr1suShP9MioTVfhSKuv-z-22fQDkU15q-cWi47lUBBYdUdbVvTQpCsD63GHuq0DF9i5BPrDTLW7BPNYVTTYcv3sqZWlyWoZYrKeAfulLAhe83QCNB1R0i4rNJpcPKhO83ASVHuUty1sEbAMdSnzJYepCoD70dXvRHrMuLoA6tuM Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:17:46.650766 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b57441fed5b5437581930346bf9116ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b57441fed5b5437581930346bf9116ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: b7e467910de54b7ea55cb2d728a8c9be Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.653483 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '16ce9439-b753-41cb-a9b1-042db35be70b'} Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:17:46.654368 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.656256 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.657707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Returning 404 to user: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:17:46.657707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5461a0a4-9d51-4340-ac23-735ba0e5953f tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 404 len: 111 microversion: 2.20 time: 0.031212 Jul 26 15:17:46.657707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 618/1257] 10.222.0.94 () {60 vars in 1280 bytes} [Tue Jul 26 15:17:46 2022] DELETE /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:17:46.663076 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:46.663743 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] [instance: 16ce9439-b753-41cb-a9b1-042db35be70b] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:46.666047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:46.671147 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:46.671615 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:46.672386 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:46.672817 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:46.687802 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] HTTP exception thrown: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Request method failure captured: Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b HTTP/1.1 Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ARGr1suShP9MioTVfhSKuv-z-22fQDkU15q-cWi47lUBBYdUdbVvTQpCsD63GHuq0DF9i5BPrDTLW7BPNYVTTYcv3sqZWlyWoZYrKeAfulLAhe83QCNB1R0i4rNJpcPKhO83ASVHuUty1sEbAMdSnzJYepCoD70dXvRHrMuLoA6tuM Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:17:46.689336 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b57441fed5b5437581930346bf9116ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b57441fed5b5437581930346bf9116ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b57441fed5b5437581930346bf9116ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: b57441fed5b5437581930346bf9116ef Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1701692660 Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: b7e467910de54b7ea55cb2d728a8c9be Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1701692660-project Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.691268 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '16ce9439-b753-41cb-a9b1-042db35be70b'} Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:17:46.692090 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. Jul 26 15:17:46.693452 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:17:46.694582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] Returning 404 to user: Instance 16ce9439-b753-41cb-a9b1-042db35be70b could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:17:46.694582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-1dfcad5d-bf94-400e-adcb-527b704b30d6 tempest-AttachVolumeShelveTestJSON-1701692660 tempest-AttachVolumeShelveTestJSON-1701692660-project] 10.222.0.94 "GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b" status: 404 len: 111 microversion: 2.20 time: 0.032049 Jul 26 15:17:46.694582 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 640/1258] 10.222.0.94 () {60 vars in 1277 bytes} [Tue Jul 26 15:17:46 2022] GET /compute/v2.1/servers/16ce9439-b753-41cb-a9b1-042db35be70b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:18:29.244285 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:18:29.245165 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:19:09.494501 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:09.495316 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=7 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:09.499143 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1870590965", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-432699790", "security_groups": [{"name": "tempest-secgroup-smoke-1921348991"}], "block_device_mapping_v2": [{"uuid": "a1b9d843-17ba-495b-b3a5-6d058f0db498", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987fc3bc-a943-4666-a158-3d1f2187f71f"}]}} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:09.617786 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.network.neutron [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] validate_networks() for [('987fc3bc-a943-4666-a158-3d1f2187f71f', None, None, None, None, None)] {{(pid=130764) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:19:10.111323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Flavor limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:19:10.111598 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Image limits 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:19:10.112066 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Flavor pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:19:10.112522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Image pref 0:0:0 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:19:10.112930 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.virt.hardware [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:19:10.122472 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:10.122914 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:10.123752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:10.124191 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:10.141973 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:19:10.146752 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.quota [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Getting quotas for user c11f43d5614d46cd996789819075520d and project aba3d424c6e64b9fb2b0c5e16eb42763. Resources: {'ram', 'instances', 'cores'} {{(pid=130764) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:19:10.207493 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Going to run 1 instances... {{(pid=130764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:19:10.209811 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1b9d843-17ba-495b-b3a5-6d058f0db498',volume_size=None,volume_type=None)] {{(pid=130764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:19:10.646866 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-83c59c6a-7c05-411e-8fa7-a419050f2d2e tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.154055 Jul 26 15:19:10.647893 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 619/1259] 10.222.0.94 () {60 vars in 1147 bytes} [Tue Jul 26 15:19:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:19:10.656750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=17 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:10.661863 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e44d0272-8df3-47e9-900e-fc1c64dcc80a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:10.662482 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e44d0272-8df3-47e9-900e-fc1c64dcc80a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:10.723064 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e44d0272-8df3-47e9-900e-fc1c64dcc80a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:10.731370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e44d0272-8df3-47e9-900e-fc1c64dcc80a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1094 microversion: 2.1 time: 0.076723 Jul 26 15:19:10.731986 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 641/1260] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:10 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:11.753342 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:11.753942 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:11.760744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:11.761206 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:11.761978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:11.762421 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:11.826710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:11.835136 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f4b3139f-42d0-426b-ac13-a7571158f60a tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1144 microversion: 2.1 time: 0.085445 Jul 26 15:19:11.835949 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 620/1261] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:11 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:12.856947 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:12.857563 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:12.864620 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:12.865221 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:12.866000 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:12.866461 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:12.936602 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:12.945035 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-e6d53174-0c5d-4b60-8712-736389afcbe9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1200 microversion: 2.1 time: 0.092256 Jul 26 15:19:12.945959 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 642/1262] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:12 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:13.968054 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:13.968662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:13.975879 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:13.976323 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:13.977086 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:13.977514 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:14.196278 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:14.204344 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-ecf5ce97-c43a-4938-9d81-b020d1ad4712 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1278 microversion: 2.1 time: 0.240146 Jul 26 15:19:14.205164 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 621/1263] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:13 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:19:14.904589 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-af34195e-4aae-4327-ab5d-da376f36719a req-309c91b9-fe7e-4d2e-894c-b6d010447230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4f3381-31cd-45c4-9ddc-2046ab06d229", "tag": "4b1f6954-edc0-4e19-98df-3a6bd0084555"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:14.915823 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-af34195e-4aae-4327-ab5d-da376f36719a req-309c91b9-fe7e-4d2e-894c-b6d010447230 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:14.916306 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-af34195e-4aae-4327-ab5d-da376f36719a req-309c91b9-fe7e-4d2e-894c-b6d010447230 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:14.929569 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-af34195e-4aae-4327-ab5d-da376f36719a req-309c91b9-fe7e-4d2e-894c-b6d010447230 service nova] Creating event network-changed:4b1f6954-edc0-4e19-98df-3a6bd0084555 for instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 on hv-cinder-85066 Jul 26 15:19:14.938202 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-af34195e-4aae-4327-ab5d-da376f36719a req-309c91b9-fe7e-4d2e-894c-b6d010447230 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037733 Jul 26 15:19:14.939160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 643/1264] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:15.233299 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:15.233928 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:15.241807 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:15.247664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:15.247664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:15.247664 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:15.483099 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:15.492734 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-718d5f9a-594b-4ed9-afe9-c22493ef4090 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.263341 Jul 26 15:19:15.493490 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 622/1265] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:15 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:16.515026 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:16.515776 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:16.522732 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:16.523178 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:16.523984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:16.524420 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:16.662290 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:16.670288 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-864e9f95-86f0-4c62-9472-a2ccc2545b38 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.159888 Jul 26 15:19:16.670857 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 644/1266] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:16 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:17.692337 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:17.693039 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:17.699852 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:17.700309 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:17.701078 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:17.701515 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:17.847668 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:17.855946 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-6afb9e58-62e9-4903-97cb-388840585702 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.167422 Jul 26 15:19:17.856522 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 623/1267] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:17 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:18.876409 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:18.877011 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:18.884346 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:18.884789 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:18.885539 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:18.885965 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:19.023401 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:19.031820 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-225a65b1-e65d-4606-ad29-4317878a5eb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.159205 Jul 26 15:19:19.032397 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 645/1268] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:18 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:20.130906 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=2 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:20.153584 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell0:SELECT=6 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:20.169138 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:20.169755 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:20.176466 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:20.177060 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:20.177681 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:20.178523 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:20.317824 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:20.325898 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-361dafa5-7e29-4815-87c7-48d83e9f5a24 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.277428 Jul 26 15:19:20.326057 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 624/1269] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:20 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:21.346030 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:21.346697 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:21.349213 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell0:SELECT=2 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:21.354372 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:21.354825 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:21.355630 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:21.356158 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:21.493891 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:21.502051 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8ae5a3ae-75c8-4ea2-9f0a-996e57250e1b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.159997 Jul 26 15:19:21.502611 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 646/1270] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:21 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:22.523173 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:22.523933 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:22.530663 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:22.531115 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:22.531936 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:22.532425 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:22.667349 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:22.675192 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-23c2db4f-ce21-42e9-8236-dca5a5bf36b0 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.155915 Jul 26 15:19:22.675791 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 625/1271] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:22 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:23.697097 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:23.697736 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:23.704404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:23.704855 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:23.705624 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:23.706059 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:23.862877 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:23.870836 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-a3eda6fa-7391-413f-adbf-3a3282a0406b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.177840 Jul 26 15:19:23.871418 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 647/1272] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:23 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:24.892751 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:24.893934 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:24.905593 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:24.906387 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:24.907829 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:24.908638 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:25.057390 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:25.065881 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-682b57eb-d19b-4594-9dd1-26417bca99ba tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.177735 Jul 26 15:19:25.071176 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 626/1273] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:24 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:25.218960 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-314ec925-ee4f-4802-929e-a83cb2a33553 req-232682f3-c671-468b-b3cc-e457f43b798c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4f3381-31cd-45c4-9ddc-2046ab06d229", "name": "network-vif-plugged", "status": "completed", "tag": "4b1f6954-edc0-4e19-98df-3a6bd0084555"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:25.229519 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-314ec925-ee4f-4802-929e-a83cb2a33553 req-232682f3-c671-468b-b3cc-e457f43b798c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:25.229961 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-314ec925-ee4f-4802-929e-a83cb2a33553 req-232682f3-c671-468b-b3cc-e457f43b798c service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:25.242501 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-314ec925-ee4f-4802-929e-a83cb2a33553 req-232682f3-c671-468b-b3cc-e457f43b798c service nova] Creating event network-vif-plugged:4b1f6954-edc0-4e19-98df-3a6bd0084555 for instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 on hv-cinder-85066 Jul 26 15:19:25.248350 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-314ec925-ee4f-4802-929e-a83cb2a33553 req-232682f3-c671-468b-b3cc-e457f43b798c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Jul 26 15:19:25.248977 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 648/1274] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:19:26.086439 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:26.087012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:26.093812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.094267 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.095050 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.095504 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.243530 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:26.251804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-359de48d-730b-42ed-b30f-7b4256428cb7 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1266 microversion: 2.1 time: 0.169301 Jul 26 15:19:26.252378 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 627/1275] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:26 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:27.273651 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:27.274456 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:27.281264 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:27.281749 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:27.282570 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:27.283308 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:27.437662 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:27.445472 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-da9d46cb-72bb-40d2-81b4-eaa0cf53c07b tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1453 microversion: 2.1 time: 0.176500 Jul 26 15:19:27.446475 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 649/1276] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:27 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:27.467709 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:27.468308 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:27.474703 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:27.475174 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:27.475990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:27.476423 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:27.611605 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:27.619248 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-8bfa74c5-c4b3-49dd-aad6-c708ca2086b3 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1453 microversion: 2.1 time: 0.155697 Jul 26 15:19:27.619978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 628/1277] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:27 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:19:30.124057 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-a6a1ae31-64c1-49ff-9721-d3543465db9f req-ceb704a8-f049-4141-a0b4-fc6958dc44a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4f3381-31cd-45c4-9ddc-2046ab06d229", "tag": "4b1f6954-edc0-4e19-98df-3a6bd0084555"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:30.135341 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-a6a1ae31-64c1-49ff-9721-d3543465db9f req-ceb704a8-f049-4141-a0b4-fc6958dc44a5 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:30.135938 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-a6a1ae31-64c1-49ff-9721-d3543465db9f req-ceb704a8-f049-4141-a0b4-fc6958dc44a5 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:30.148404 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-a6a1ae31-64c1-49ff-9721-d3543465db9f req-ceb704a8-f049-4141-a0b4-fc6958dc44a5 service nova] Creating event network-changed:4b1f6954-edc0-4e19-98df-3a6bd0084555 for instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 on hv-cinder-85066 Jul 26 15:19:30.154071 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-a6a1ae31-64c1-49ff-9721-d3543465db9f req-ceb704a8-f049-4141-a0b4-fc6958dc44a5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Jul 26 15:19:30.154694 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 650/1278] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:58.039646 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:19:58.040392 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:19:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:20:10.218806 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:20:10.219576 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:20:37.895775 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:20:37.896424 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:21:11.353048 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:11.354976 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG dbcounter [-] [130764] Writing DB stats nova_cell1:SELECT=56 {{(pid=130764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:11.356460 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_api:SELECT=23 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:11.357375 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG dbcounter [-] [130762] Writing DB stats nova_cell1:SELECT=42 {{(pid=130762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:11.359510 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:11.360221 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:11.367642 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.375662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:11.375662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.375662 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:11.396679 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Going to try to terminate instance {{(pid=130764) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:21:11.552109 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-59bcb607-3273-4221-943f-588275199b92 req-9882f6ef-759d-4cfc-aa4b-8a1c47bb8a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4f3381-31cd-45c4-9ddc-2046ab06d229", "tag": "4b1f6954-edc0-4e19-98df-3a6bd0084555"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:11.563964 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-59bcb607-3273-4221-943f-588275199b92 req-9882f6ef-759d-4cfc-aa4b-8a1c47bb8a3e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.564581 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-59bcb607-3273-4221-943f-588275199b92 req-9882f6ef-759d-4cfc-aa4b-8a1c47bb8a3e service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:11.576771 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-59bcb607-3273-4221-943f-588275199b92 req-9882f6ef-759d-4cfc-aa4b-8a1c47bb8a3e service nova] Creating event network-changed:4b1f6954-edc0-4e19-98df-3a6bd0084555 for instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 on hv-cinder-85066 Jul 26 15:21:11.582360 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-59bcb607-3273-4221-943f-588275199b92 req-9882f6ef-759d-4cfc-aa4b-8a1c47bb8a3e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228575 Jul 26 15:21:11.582966 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 651/1279] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:11.862167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-d6fefc3e-a879-4b67-a3a4-828bcb071f4d tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "DELETE /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 204 len: 0 microversion: 2.1 time: 0.510634 Jul 26 15:21:11.862962 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 629/1280] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:21:11 2022] DELETE /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:21:11.872684 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:11.879683 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:11.880876 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.881388 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:11.882502 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.882645 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:12.127801 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:12.136984 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0e4c4342-cc32-4929-8a2f-7425e458fdf2 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1578 microversion: 2.1 time: 0.269018 Jul 26 15:21:12.142440 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 652/1281] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:11 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1578 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:13.158743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:13.159440 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:13.167253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:13.167733 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:13.168494 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:13.168929 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:13.431312 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:13.439536 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-61c1fd7b-fc55-40cf-87d6-145ebe64b496 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1578 microversion: 2.1 time: 0.285004 Jul 26 15:21:13.440126 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 630/1282] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:13 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1578 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:14.272574 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [req-d58bec24-f9aa-455d-838d-447d6698e42e req-6eaabce1-2092-48e2-917d-5fb8b174d83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4f3381-31cd-45c4-9ddc-2046ab06d229", "name": "network-vif-deleted", "tag": "4b1f6954-edc0-4e19-98df-3a6bd0084555"}]} {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:14.283069 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-d58bec24-f9aa-455d-838d-447d6698e42e req-6eaabce1-2092-48e2-917d-5fb8b174d83f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:14.283572 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [req-d58bec24-f9aa-455d-838d-447d6698e42e req-6eaabce1-2092-48e2-917d-5fb8b174d83f service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:14.295699 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.compute.server_external_events [req-d58bec24-f9aa-455d-838d-447d6698e42e req-6eaabce1-2092-48e2-917d-5fb8b174d83f service nova] Creating event network-vif-deleted:4b1f6954-edc0-4e19-98df-3a6bd0084555 for instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 on hv-cinder-85066 Jul 26 15:21:14.300775 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [req-d58bec24-f9aa-455d-838d-447d6698e42e req-6eaabce1-2092-48e2-917d-5fb8b174d83f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088068 Jul 26 15:21:14.301544 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 653/1283] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:14.460680 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:14.461230 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:14.468707 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:14.469157 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:14.469978 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:14.470416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:14.538463 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:14.547040 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-1284c2f4-238f-464f-80fe-7950c6c9bfac tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1225 microversion: 2.1 time: 0.090352 Jul 26 15:21:14.547643 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 631/1284] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:14 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:15.569061 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:15.571935 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:15.578201 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:15.578753 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:15.579595 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:15.580036 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:15.612828 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:15.613315 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:15.613761 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.objects.instance [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lazy-loading 'fault' on Instance uuid bb4f3381-31cd-45c4-9ddc-2046ab06d229 {{(pid=130762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:21:15.657774 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:15.665630 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0a085fde-36b2-4cb8-abf8-8aba5d6eb907 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 200 len: 1230 microversion: 2.1 time: 0.100857 Jul 26 15:21:15.666218 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 654/1285] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:15 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:16.687991 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:16.688591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: bb4f3381-31cd-45c4-9ddc-2046ab06d229] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:16.695012 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:16.695453 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:16.696338 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:16.696800 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:16.710499 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] HTTP exception thrown: Instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 could not be found. Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Request method failure captured: Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 HTTP/1.1 Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ATC_X4VTXMISzaQyhtch01fHngxkTuuxuMjkN3ZOx5NC15GZedtPf9BjBPzWIa1bqXSznEXDeeOnOhDj3lsjMP6d3pf0S_8-K0ELZEd6oexWnMO0r0rdMZFgiC1qkAJ30wNGQx_zVOIQ54YA5PxaCrC0Z1okjf06I6bRSP8p_tpMSs Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:21:16.712156 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: c11f43d5614d46cd996789819075520d Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 could not be found. Jul 26 15:21:16.714244 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': 'bb4f3381-31cd-45c4-9ddc-2046ab06d229'} Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 could not be found. Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:21:16.715371 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 could not be found. Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 could not be found. Jul 26 15:21:16.717283 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:16.718814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Returning 404 to user: Instance bb4f3381-31cd-45c4-9ddc-2046ab06d229 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:21:16.718814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5068b42c-0e17-4cc7-867c-973cfd55a794 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229" status: 404 len: 111 microversion: 2.1 time: 0.029531 Jul 26 15:21:16.718814 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 632/1286] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:16 2022] GET /compute/v2.1/servers/bb4f3381-31cd-45c4-9ddc-2046ab06d229 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:20.417389 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:20.418619 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:20.421004 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-c74d9cee-493e-4667-a267-67ff969203bc req-b76ba9a8-20b6-44ca-93c6-568d238916e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2ab780-c607-449f-9f92-fe2110637abf", "tag": "cc7346d4-6d21-435c-9ce5-c47d964c5453"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:20.425677 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:20.426061 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:20.426827 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:20.427258 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:20.431598 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-c74d9cee-493e-4667-a267-67ff969203bc req-b76ba9a8-20b6-44ca-93c6-568d238916e8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:20.432127 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-c74d9cee-493e-4667-a267-67ff969203bc req-b76ba9a8-20b6-44ca-93c6-568d238916e8 service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:20.444667 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-c74d9cee-493e-4667-a267-67ff969203bc req-b76ba9a8-20b6-44ca-93c6-568d238916e8 service nova] Creating event network-changed:cc7346d4-6d21-435c-9ce5-c47d964c5453 for instance fd2ab780-c607-449f-9f92-fe2110637abf on hv-cinder-85066 Jul 26 15:21:20.450653 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-c74d9cee-493e-4667-a267-67ff969203bc req-b76ba9a8-20b6-44ca-93c6-568d238916e8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034863 Jul 26 15:21:20.451947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 633/1287] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:21:20.459958 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Going to try to terminate instance {{(pid=130762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:21:20.874887 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-0ef9adbf-6e27-4be1-acde-adc3f30fba13 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "DELETE /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 204 len: 0 microversion: 2.1 time: 0.461207 Jul 26 15:21:20.876196 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 655/1288] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:21:20 2022] DELETE /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:21:20.885441 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:20.886369 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:20.893587 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:20.896899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:20.896899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:20.896899 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:21.082292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:21.090744 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-5d283a9f-910f-40ed-a0c6-5da264fe7dae tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1577 microversion: 2.1 time: 0.209888 Jul 26 15:21:21.091416 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 634/1289] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:20 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:22.113620 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:22.114335 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:22.121454 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:22.121901 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:22.122725 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:22.123490 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:22.284160 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:22.291809 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-245cbe8b-4f02-4e2d-b050-de27858d1490 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1577 microversion: 2.1 time: 0.182773 Jul 26 15:21:22.292377 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 656/1290] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:22 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:22.563167 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:21:22.563804 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:21:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:21:23.161574 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [req-d704ad0f-df69-4d64-8c0a-bf00009e0a23 req-4ff7dde1-c9b6-4e15-be0a-ca7d6343d2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2ab780-c607-449f-9f92-fe2110637abf", "name": "network-vif-deleted", "tag": "cc7346d4-6d21-435c-9ce5-c47d964c5453"}]} {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:23.171990 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-d704ad0f-df69-4d64-8c0a-bf00009e0a23 req-4ff7dde1-c9b6-4e15-be0a-ca7d6343d2fb service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:23.172440 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [req-d704ad0f-df69-4d64-8c0a-bf00009e0a23 req-4ff7dde1-c9b6-4e15-be0a-ca7d6343d2fb service nova] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:23.183743 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.compute.server_external_events [req-d704ad0f-df69-4d64-8c0a-bf00009e0a23 req-4ff7dde1-c9b6-4e15-be0a-ca7d6343d2fb service nova] Creating event network-vif-deleted:cc7346d4-6d21-435c-9ce5-c47d964c5453 for instance fd2ab780-c607-449f-9f92-fe2110637abf on hv-cinder-85066 Jul 26 15:21:23.188710 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [req-d704ad0f-df69-4d64-8c0a-bf00009e0a23 req-4ff7dde1-c9b6-4e15-be0a-ca7d6343d2fb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030786 Jul 26 15:21:23.189380 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 635/1291] 10.222.0.94 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:23.314643 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:23.315334 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:23.322167 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:23.322609 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:23.323402 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:23.323852 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:23.392783 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.policy [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:23.401131 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6e565f83-7bc7-4996-8d02-c1fe11b3ca2c tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1390 microversion: 2.1 time: 0.091256 Jul 26 15:21:23.401717 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 657/1292] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:23 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:24.423947 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:24.424575 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:24.431003 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:24.436253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:24.436253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:24.436253 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:24.467834 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:24.468292 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:24.468756 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.objects.instance [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lazy-loading 'fault' on Instance uuid fd2ab780-c607-449f-9f92-fe2110637abf {{(pid=130764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:21:24.516659 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.policy [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f43d5614d46cd996789819075520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba3d424c6e64b9fb2b0c5e16eb42763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130764) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:24.524812 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-cb107f43-291b-4f91-8f2e-c5a66dad4af4 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 200 len: 1229 microversion: 2.1 time: 0.105891 Jul 26 15:21:24.525296 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 636/1293] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:24 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:21:25.547267 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:25.547907 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: fd2ab780-c607-449f-9f92-fe2110637abf] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:25.554370 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:25.554814 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:25.555597 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:25.556033 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:25.569316 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] HTTP exception thrown: Instance fd2ab780-c607-449f-9f92-fe2110637abf could not be found. Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Request method failure captured: Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf HTTP/1.1 Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ATC_X4VTXMISzaQyhtch01fHngxkTuuxuMjkN3ZOx5NC15GZedtPf9BjBPzWIa1bqXSznEXDeeOnOhDj3lsjMP6d3pf0S_8-K0ELZEd6oexWnMO0r0rdMZFgiC1qkAJ30wNGQx_zVOIQ54YA5PxaCrC0Z1okjf06I6bRSP8p_tpMSs Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:21:25.570962 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: c11f43d5614d46cd996789819075520d Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance fd2ab780-c607-449f-9f92-fe2110637abf could not be found. Jul 26 15:21:25.572698 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': 'fd2ab780-c607-449f-9f92-fe2110637abf'} Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2ab780-c607-449f-9f92-fe2110637abf could not be found. Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:21:25.573755 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2ab780-c607-449f-9f92-fe2110637abf could not be found. Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2ab780-c607-449f-9f92-fe2110637abf could not be found. Jul 26 15:21:25.575385 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:25.577613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Returning 404 to user: Instance fd2ab780-c607-449f-9f92-fe2110637abf could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:21:25.577613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-6378ec59-e7a3-4c09-9ddd-a67557b42f43 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf" status: 404 len: 111 microversion: 2.1 time: 0.029994 Jul 26 15:21:25.577613 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 658/1294] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:25 2022] GET /compute/v2.1/servers/fd2ab780-c607-449f-9f92-fe2110637abf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:26.136073 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:26.136590 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.compute.api [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130764) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:26.143980 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:26.144433 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:26.145251 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:26.145689 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG oslo_concurrency.lockutils [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:26.160500 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.wsgi [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] HTTP exception thrown: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Request method failure captured: Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: request: DELETE /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 HTTP/1.1 Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept: application/json Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Accept-Encoding: identity Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Connection: close Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Length: 0 Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Content-Type: application/json Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Host: 10.222.0.94 Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Openstack-System-Scope: None Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: User-Agent: python-urllib3/1.26.10 Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Auth-Token: gAAAAABi4ATC_X4VTXMISzaQyhtch01fHngxkTuuxuMjkN3ZOx5NC15GZedtPf9BjBPzWIa1bqXSznEXDeeOnOhDj3lsjMP6d3pf0S_8-K0ELZEd6oexWnMO0r0rdMZFgiC1qkAJ30wNGQx_zVOIQ54YA5PxaCrC0Z1okjf06I6bRSP8p_tpMSs Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Id: None Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Domain-Name: None Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Identity-Status: Confirmed Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Is-Admin-Project: True Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Id: default Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Domain-Name: Default Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Project-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Role: reader,member Jul 26 15:21:26.162577 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Roles: reader,member Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-Tenant-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Id: default Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Domain-Name: Default Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Id: c11f43d5614d46cd996789819075520d Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: X-User-Name: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: method: > Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: exception: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.164144 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: action_args: {'id': '96bbf918-a33a-4c1a-9a56-1705a2b1c349'} Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:21:26.165276 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.167008 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.168850 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Returning 404 to user: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. {{(pid=130764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:21:26.168850 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-f015e771-0e5e-43d2-b892-297e308fd3a5 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "DELETE /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 404 len: 111 microversion: 2.1 time: 0.032543 Jul 26 15:21:26.168850 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 637/1295] 10.222.0.94 () {58 vars in 1239 bytes} [Tue Jul 26 15:21:26 2022] DELETE /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:26.173954 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '>' {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:26.174578 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.compute.api [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] [instance: 96bbf918-a33a-4c1a-9a56-1705a2b1c349] Fetching instance by UUID {{(pid=130762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:26.180782 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:26.181185 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:26.181937 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:26.182365 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG oslo_concurrency.lockutils [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Lock "edd000c1-ec71-4e3a-8f05-9866da848ed5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:26.196654 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.wsgi [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] HTTP exception thrown: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Request method failure captured: Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: request: GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 HTTP/1.1 Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept: application/json Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Accept-Encoding: identity Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Connection: close Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Length: 0 Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Content-Type: application/json Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Host: 10.222.0.94 Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Openstack-System-Scope: None Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: User-Agent: python-urllib3/1.26.10 Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Auth-Token: gAAAAABi4ATC_X4VTXMISzaQyhtch01fHngxkTuuxuMjkN3ZOx5NC15GZedtPf9BjBPzWIa1bqXSznEXDeeOnOhDj3lsjMP6d3pf0S_8-K0ELZEd6oexWnMO0r0rdMZFgiC1qkAJ30wNGQx_zVOIQ54YA5PxaCrC0Z1okjf06I6bRSP8p_tpMSs Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Id: None Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Domain-Name: None Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Identity-Status: Confirmed Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Is-Admin-Project: True Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Id: default Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Domain-Name: Default Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Project-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Role: reader,member Jul 26 15:21:26.198233 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Roles: reader,member Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aba3d424c6e64b9fb2b0c5e16eb42763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}] Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Id: aba3d424c6e64b9fb2b0c5e16eb42763 Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-Tenant-Name: tempest-TestVolumeBootPattern-334829638 Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Id: default Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Domain-Name: Default Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Id: c11f43d5614d46cd996789819075520d Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: X-User-Name: tempest-TestVolumeBootPattern-334829638-project Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: method: > Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: exception: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.200047 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: action_args: {'id': '96bbf918-a33a-4c1a-9a56-1705a2b1c349'} Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: {{(pid=130762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:21:26.201070 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. Jul 26 15:21:26.202750 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: ERROR nova.api.openstack.wsgi Jul 26 15:21:26.204536 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: DEBUG nova.api.openstack.wsgi [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Returning 404 to user: Instance 96bbf918-a33a-4c1a-9a56-1705a2b1c349 could not be found. {{(pid=130762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:21:26.204536 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO nova.api.openstack.requestlog [None req-8295c81e-10a9-4b18-b237-64f343678ba9 tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349" status: 404 len: 111 microversion: 2.1 time: 0.030498 Jul 26 15:21:26.204536 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: [pid: 130762|app: 0|req: 659/1296] 10.222.0.94 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:26 2022] GET /compute/v2.1/servers/96bbf918-a33a-4c1a-9a56-1705a2b1c349 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:27.937591 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: DEBUG nova.api.openstack.wsgi [None req-abecd99a-6f18-46f9-b994-86dba70a35ca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] Calling method '.version_select at 0x7f4536971160>' {{(pid=130764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:28.056714 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO nova.api.openstack.requestlog [None req-abecd99a-6f18-46f9-b994-86dba70a35ca tempest-TestVolumeBootPattern-334829638 tempest-TestVolumeBootPattern-334829638-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-432699790" status: 202 len: 0 microversion: 2.1 time: 0.124190 Jul 26 15:21:28.057294 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: [pid: 130764|app: 0|req: 638/1297] 10.222.0.94 () {58 vars in 1260 bytes} [Tue Jul 26 15:21:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-432699790 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:21:49.254862 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:21:49.255454 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:23:18.051015 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:23:18.051709 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:23:30.227024 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:23:30.227780 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:23:47.003043 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:23:47.003819 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:23:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:23:57.904334 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:23:57.904958 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:23:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:24:42.571774 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:24:42.572525 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:24:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:25:09.263882 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:25:09.264813 dv-cinder-850668-2-iscsi devstack@n-api.service[130764]: Tue Jul 26 15:25:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:26:38.058803 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:26:38.059495 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:26:50.235673 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:26:50.236449 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:27:07.013040 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:27:07.013742 dv-cinder-850668-2-iscsi devstack@n-api.service[130762]: Tue Jul 26 15:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!